Main Question
Our main question:
- How does the inclusion of different numbers of age groups influence the results of an analysis of right to carry laws and violence rates?
Open Case Studies: Examination of Multicollinearity Influence on Inference Using Right-to-Carry Gun Law and Violent Crime Data
Michael Ontiveros, Carrie Wright, PhD.
Disclaimer: The purpose of the Open Case Studies project is to demonstrate the use of various data science methods, tools, and software in the context of messy, real-world data. A given case study does not cover all aspects of the research process, is not claiming to be the most appropriate way to analyze a given data set, and should not be used in the context of making policy decisions without external consultation from scientific experts.
This work is licensed under the Creative Commons Attribution-NonCommercial 3.0 (CC BY-NC 3.0) United States License.
Motivation
This case study will introduce the topic of multicolinearity. We will do so by showcasing a real world example where multicolinearity in part resulted in historically contriversial and conflicting findings about the influence of the adoption of right-to-carry (RTC) concealed handgun laws on violent crime rates in the United States.
We will focus on two articles:
- The first analysis by Lott and Mustard published in 1996 suggests that RTC laws reduce violent crime. Lott authored a book extending these findings in 1998 called More Guns, Less Crime.
- The second analysis is a recent article by Donohue, et al. published in 2017 that suggests that RTC laws increase violent crime. Donohue has also published previous articles with titles such as “Shooting down the”More Guns, Less Crime" Hypothesis
This has been a controversial topic as many other articles also had conflicting results. See here for a list of studies.
The Donohue, et al. article discusses how there are many other important methodolical aspects besides multicolinearity that could account for the historically conflicting results in these previous papers.
In fact, nearly every aspect of the data analysis process was different between the Donohue, et al. analysis and the Lott and Mustard analysis.
However, we will focus particularly on multicolinearity and we will explore how it can influence linear regression analyses and result in different conclusions.
This analysis will demonstrate how methodological details can be critically influential for our overall conclusions and can result in important policy related consequences. This article will provide a basis for the motivation.
John J. Donohue et al., Right‐to‐Carry Laws and Violent Crime: A Comprehensive Assessment Using Panel Data and a State‐Level Synthetic Control Analysis. Journal of Empirical Legal Studies, 16,2 (2019).
David B. Mustard & John Lott. Crime, Deterrence, and Right-to-Carry Concealed Handguns. Coase-Sandor Institute for Law & Economics Working Paper No. 41, (1996).
Here you can see the differences in the data used in the featured RTC articles:
We will perform analyses similar to those in these articles, however we will not try to recreate them, instead we will simplify our analysis to allow us to focus on multicolinearity.
Therefore we will use a subset of the listed explanatory variables and they will be consistent for both analyses that we will perform, with the exception that one analysis will have 6 demographic variables like the analysis in the Donohue, et al. article and the other will have 36 demogrpahic variables like the analysis in the Lott and Mustard article.
Learning Objectives
Statistical Learning Objectives:
In this case study, students will learn:
1) what multicolinearity is and how it can influence linear regression coefficients
2) how to look for the presence of multicolinarity
3) the difference between multicolinearity and correlation
Data science Learning Objectives:
- joining data from multiple sources (dplyr)
- reshaping data into different formats (tidyr)
- visualizations (ggplot2)
We will especially focus on using packages and functions from the Tidyverse, such as dplyr and ggplot2. The tidyverse is a library of packages created by RStudio. While some students may be familiar with previous R programming packages, these packages make data science in R especially efficient.
Context
So what exactly is a right-to-carry law?
It is a law thatspecifies if and how citizens are allowed to have a firearm on their person or nearby (for example in the citizen’s car) in public.
The Second Amendment to the United States Constitution guarantees the right to “keep and bear arms”. The amendment was ratified in 1791 as part of the Bill of Rights.
However, there are no federal laws about carrying firearms in public.
These laws are created and enforced at the state level. Sates vary greatly in their laws about the right to carry firearms. Some require extensive effort to obtain a permit to legally carry a firearm, while other states require very minimal effort to legally carry a firearm.
According to Wikipedia about the history of right-to-carry policies in the United States:
Public perception on concealed carry vs open carry has largely flipped. In the early days of the United States, open carrying of firearms, long guns and revolvers was a common and well-accepted practice. Seeing guns carried openly was not considered to be any cause for alarm. Therefore, anyone who would carry a firearm but attempt to conceal it was considered to have something to hide, and presumed to be a criminal. For this reason, concealed carry was denounced as a detestable practice in the early days of the United States.
Concealed weapons bans were passed in Kentucky and Louisiana in 1813. (In those days open carry of weapons for self-defense was considered acceptable; concealed carry was denounced as the practice of criminals.) By 1859, Indiana, Tennessee, Virginia, Alabama, and Ohio had followed suit. By the end of the nineteenth century, similar laws were passed in places such as Texas, Florida, and Oklahoma, which protected some gun rights in their state constitutions. Before the mid 1900s, most U.S. states had passed concealed carry laws rather than banning weapons completely. Until the late 1990s, many Southern states were either “No-Issue” or “Restrictive May-Issue”. Since then, these states have largely enacted “Shall-Issue” licensing laws, with numerous states legalizing “Unrestricted concealed carry”.
See here for more information.
Here are the general categories of Right to Carry Laws:
You can see that none of the fifty states have no-issue laws currently, meaning that all states allow the right to carry firearms at least in some way, however the level of restrictions is dramatically different from one state to another.
Here you can see how these laws have changed over time around the country: 
There is variation from state to state even within the same general category:
For example here are the current carry laws in Idaho which is considered an “Unrestricted - no permit required” state:
Idaho permits the open carrying of firearms.
Idaho law permits both residents and non-residents who are at least 18 years old to carry concealed weapons, without a carry license, outside the limits of or confines of any city, provided the person is not otherwise disqualified from being issued a license to carry.
A person may also carry concealed weapons on or about his or her person, without a license, in the person’s own place of abode or fixed place of business, on property in which the person has any ownership or leasehold interest, or on private property where the person has permission to carry from any person who has an ownership or leasehold interest in that property.
State law also allows any resident of Idaho or a current member of the armed forces of the United States to carry a concealed handgun without a license to carry, provided the person is over 18 years old and not disqualified from being issued a license to carry concealed weapons under state law. An amendment to state law that takes effect on July 1, 2020 changes the reference in the above law from “a resident of Idaho” to “any citizen of the United States.”
And here are the current carry laws in Arizona which is also considered an “Unrestricted- - no permit required” state:
Arizona respects the right of law abiding citizens to openly carry a handgun.
Any person 21 years of age or older, who is not prohibited possessor, may carry a weapon openly or concealed without the need for a license. Any person carrying without a license must acknowledge and comply with the demands of a law enforcement officer when asked if he/she is carrying a concealed deadly weapon, if the officer has initiated an “investigation” such as a traffic stop.
Notice that citizens in Idaho only need to be 18 to carry a firearm, whereas they must be 21 in Arizona.
In contrast here is an example of current carry laws in Maryland which is considered a “Rights Restricted-Very Limited Issue” state:
Carrying and Transportation in Vehicles It is unlawful for any person without a permit to wear or carry a handgun, openly or concealed, upon or about his person. It is also unlawful for any person to knowingly transport a handgun in any vehicle traveling on public roads, highways, waterways or airways, or upon roads or parking lots generally used by the public. This does not apply to any person wearing, carrying or transporting a handgun within the confines of real estate owned or leased by him, or on which he resides, or within the confines of a business establishment owned or leased by him.
Permit To Carry Application for a permit to carry a handgun is made to the Secretary of State Police. In addition to the printed application form, the applicant should submit a notarized letter stating the reasons why he is applying for a permit.
avocado….Right to carry and covid masks?
Limitations
There are some important considerations regarding this data analysis to keep in mind:
We do not use all of the data used by either the Lott and Mustard or Donohue, et al. analyses, nor do we perform the same analysis of each article. We instead perform a much simpler analysis with less variables for the purposes of illustration of the concept of multicollinearity and its influence on regression coefficients, not to reproduce either analysis.
Because our analysis is an oversimplification, our analysis should not be used for determining policy changes, instead we suggest that users consult with a specialist.
We would also like to note that…AVOCADO It is important that we do not treat race as an objective measure. Despite this, it can be used to advance scientific inquiry. For more information on this topic, we have included a link to a paper on the use of race as a measure in epidemiology.
We will begin by loading the packages that we will need:
library(here)
library(readxl)
library(readr)
library(pdftools)
library(dplyr)
library(magrittr)
library(tidyr)
library(stringr)
library(car) # vif function
library(plm) # fixed effect model, linear regression
library(broom) # tidy output
library(tidyverse) # general wrangling functions
library(cowplot) # to produce plot of plots
library(GGally)
library(ggrepel)
library(scales)
library(latex2exp)
library(viridis)
library(ggcorrplot)
library(rsample)
set.seed(999)| Package | Use |
|---|---|
| here | to easily load and save data |
| readr | to import the CSV file data |
| [car] | to calculate vif values |
The first time we use a function, we will use the :: to indicate which package we are using. Unless we have overlapping function names, this is not necessary, but we will include it here to be informative about where the functions we will use come from.
What are the data?
Below is a table from the Donohue, et al. paper that shows the data used in both analyses, where DAW stands for Donohue, et al. and LM stands for Lott and Mustard.
We will be using a subset of these variables, which are highlighted in green:
Data Import
Demographic and Population data
To obtain information about age, sex, and race, and overall population we will use US Census Bureau data, just like both of the articles. The cesnus data is available for different time spans. Here are the links for the years used in our analysis. We will use data from 1977 to 2010.
| Data | Link |
|---|---|
| years 1977 to 1979 | link |
| years 1980 to 1989 | link * county data was used for this decade |
| years 1990 to 1999 | link |
| years 2000 to 2010 | link technical documentation |
To import the data we will use the read_csv() function of the readr package for the csv files. In some decades, there are separate files for each year, we will read each of these together using the base list.files() function to get all of the names for each file and then the map() function of the purrr package to apply the read_csv() function on all of the file paths in the list created by list.files(). For years that are txt files we will use read_table2() also fo the readr package. The read_table2() function, unlike the read_table(), allows for any number of whitespace characters between columns, and the lines can be of different lengths.
AVOCADO I am a bit confused about the last decade… it’s only one file but it seems to need map…
dem_77_79 <- read_csv("docs/Demographics/Decade_1970/pe-19.csv", skip = 5)
dem_80_89 <- list.files(recursive = TRUE,
path = "docs/Demographics/Decade_1980/",
pattern = "*.csv",
full.names = TRUE) %>%
map(~read_csv(., skip=5))
dem_90_99 <- list.files(recursive = TRUE,
path = "docs/Demographics/Decade_1990/",
pattern = "*.txt",
full.names = TRUE) %>%
map(~read_table2(., skip = 14))
dem_90_99 <- dem_90_99 %>%
map_df(bind_rows)
dem_00_10_2 <- read_csv("docs/Demographics/Decade_2000/st-est00int-alldata.csv")
dem_00_10 <- list.files(recursive = TRUE,
path = "docs/Demographics/Decade_2000/",
pattern = "*.csv",
full.names = TRUE) %>%
map(~read_csv(.))
head(dem_00_10)[[1]]
# A tibble: 62,244 x 21
REGION DIVISION STATE NAME SEX ORIGIN RACE AGEGRP ESTIMATESBASE20…
<dbl> <dbl> <dbl> <chr> <dbl> <dbl> <dbl> <dbl> <dbl>
1 0 0 0 Unit… 0 0 0 0 281424600
2 0 0 0 Unit… 0 0 0 1 19176154
3 0 0 0 Unit… 0 0 0 2 20549855
4 0 0 0 Unit… 0 0 0 3 20528425
5 0 0 0 Unit… 0 0 0 4 20218782
6 0 0 0 Unit… 0 0 0 5 18962964
7 0 0 0 Unit… 0 0 0 6 19381792
8 0 0 0 Unit… 0 0 0 7 20511067
9 0 0 0 Unit… 0 0 0 8 22707390
10 0 0 0 Unit… 0 0 0 9 22442442
# … with 62,234 more rows, and 12 more variables: POPESTIMATE2000 <dbl>,
# POPESTIMATE2001 <dbl>, POPESTIMATE2002 <dbl>, POPESTIMATE2003 <dbl>,
# POPESTIMATE2004 <dbl>, POPESTIMATE2005 <dbl>, POPESTIMATE2006 <dbl>,
# POPESTIMATE2007 <dbl>, POPESTIMATE2008 <dbl>, POPESTIMATE2009 <dbl>,
# CENSUS2010POP <dbl>, POPESTIMATE2010 <dbl>Notice that the STATE variable for the demographic data is numeric. That is because it is encoded by Federal Information Processing Standard (FIPS) state codes{target="_blank". Thus we also need to import data about FIPS encoding so that we can identify what data corresponds to what state.
##State FIPS codes
The following data was downloaded from the US Census Bureau.
To import the data we will use the read_xls() function of the readxl package. Since the first five lines of this excel is information about the source of the data and when it was released, we need to skip importing these lines using the skip argument so that the data has the same number of columns for each row.
# A tibble: 64 x 4
Region Division `State\n(FIPS)` Name
<chr> <chr> <chr> <chr>
1 1 0 00 Northeast Region
2 1 1 00 New England Division
3 1 1 09 Connecticut
4 1 1 23 Maine
5 1 1 25 Massachusetts
6 1 1 33 New Hampshire
7 1 1 44 Rhode Island
8 1 1 50 Vermont
9 1 2 00 Middle Atlantic Division
10 1 2 34 New Jersey
# … with 54 more rowsPolice staffing data
The following data was downloaded from the Federal Bureau of Investigation.
The read_csv() function of the readr package guesses what the class is for each variable, but sometimes it makes mistakes. It is good to specify the class for variables if you know them. We know that we want the variables about male and female counts to be numeric. We can specify that using the col_types = argument. See here and here for more information.
ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv")
ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv",
col_types = cols(male_total_ct = "n",
female_total_ct = "n"))
ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv",
col_types = cols(male_total_ct = col_double(),
female_total_ct = col_double()))
head(ps_data) # A tibble: 6 x 21
data_year ori pub_agency_name pub_agency_unit state_abbr division_name
<dbl> <chr> <chr> <chr> <chr> <chr>
1 1960 AK02… Alcohol Bevera… <NA> AK Pacific
2 1960 AL00… Homewood <NA> AL East South C…
3 1960 AL01… Coffeeville <NA> AL East South C…
4 1960 AL01… Coffee <NA> AL East South C…
5 1960 AL02… Mentone <NA> AL East South C…
6 1960 AL03… Greensboro <NA> AL East South C…
# … with 15 more variables: region_name <chr>, county_name <chr>,
# agency_type_name <chr>, population_group_desc <chr>, population <dbl>,
# male_officer_ct <dbl>, male_civilian_ct <dbl>, male_total_ct <dbl>,
# female_officer_ct <lgl>, female_civilian_ct <lgl>, female_total_ct <dbl>,
# officer_ct <lgl>, civilian_ct <lgl>, total_pe_ct <lgl>,
# pe_ct_per_1000 <lgl>Unemplyment data
The following data was downloaded from the U.S. Bureau of Labor Statistics.
There are excel files for each state. As you can see, there are many rows to skip to make sure that there are the same number of columns for each row. We can also see that the state name is located in a couple of the first rows.
We can also see that here if we just try to read in the files directly.
ue_rate_data <- list.files(recursive = TRUE,
path = "docs/Unemployment",
pattern = "*.xlsx",
full.names = TRUE) %>%
map(~read_xlsx(.))
head(ue_rate_data)[1][[1]]
# A tibble: 55 x 14
`Local Area Une… ...2 ...3 ...4 ...5 ...6 ...7 ...8 ...9 ...10 ...11
<chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr>
1 Original Data V… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
2 <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
3 Series Id: LAUS… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
4 Not Seasonally … <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
5 Area: Alab… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
6 Area Type: Stat… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
7 State/Region/Di… Alab… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
8 Measure: unem… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
9 Years: 1977… <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
10 <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA> <NA>
# … with 45 more rows, and 3 more variables: ...12 <chr>, ...13 <chr>,
# ...14 <chr>So now we will skip the first 10 lines. And also create a names tibble that contains only the cell with the state information.
ue_rate_data <- list.files(recursive = TRUE,
path = "docs/Unemployment",
pattern = "*.xlsx",
full.names = TRUE) %>%
map(~read_xlsx(., skip = 10))
head(ue_rate_data[1])[[1]]
# A tibble: 44 x 14
Year Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
<dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
1 1977 7.5 9 7.7 7.2 6.8 8.6 8 7.8 6.7 6.3 6.3 6
2 1978 7.1 6.9 6.2 5.4 5.1 6.9 6.7 6.7 6.5 6.3 6.3 6.5
3 1979 6.7 7.5 6.9 6.6 6.4 8.4 7.7 7.8 7.1 7.2 6.9 6.7
4 1980 7.7 7.8 7.4 7.4 8.4 9.7 10.4 10.3 9.3 9.6 9.4 9
5 1981 10 10.3 9.5 9.1 9.4 11.1 10.4 10.9 10.8 11.7 11.5 11.8
6 1982 13.2 13.2 12.9 12.6 12.8 14.5 14.7 14.8 14.7 15.1 15.4 15.3
7 1983 16 16 14.5 13.7 13.3 14.6 13.9 13.8 13.2 12.8 12.1 11.8
8 1984 12.5 12.4 11.4 10.8 10.1 11.3 11.5 11.3 10.8 10.2 9.7 10.1
9 1985 10.7 10.5 9.8 8.7 8.4 9.6 9.2 8.8 8.6 8.6 8.4 8.7
10 1986 9.3 10.4 10.1 9.4 9.4 10.5 9.7 9.6 9.7 9.7 9.6 9
# … with 34 more rows, and 1 more variable: Annual <dbl>To get the state name for each file using the map() function to perform functions across all of the files, we will specifically import only a small range of cells using the range = argument and then grab the cell that has state information based on it’s location within the range of cells imported using c() and then use the base unlist() function to unlist the list that this creates.
ue_rate_names <- list.files(recursive = TRUE,
path = "docs/Unemployment",
pattern = "*.xlsx",
full.names = TRUE) %>%
map(~read_xlsx(., range = "B4:B6")) %>%
map(., c(1,2)) %>%
unlist()
ue_rate_names [1] "Alabama" "Alaska" "Arizona"
[4] "Arkansas" "California" "Colorado"
[7] "Connecticut" "Delaware" "District of Columbia"
[10] "Florida" "Georgia" "Hawaii"
[13] "Idaho" "Illinois" "Indiana"
[16] "Iowa" "Kansas" "Kentucky"
[19] "Louisiana" "Maine" "Maryland"
[22] "Massachusetts" "Michigan" "Minnesota"
[25] "Mississippi" "Missouri" "Montana"
[28] "Nebraska" "Nevada" "New Hampshire"
[31] "New Jersey" "New Mexico" "New York"
[34] "North Carolina" "North Dakota" "Ohio"
[37] "Oklahoma" "Oregon" "Pennsylvania"
[40] "Rhode Island" "South Carolina" "South Dakota"
[43] "Tennessee" "Texas" "Utah"
[46] "Vermont" "Virginia" "Washington"
[49] "West Virginia" "Wisconsin" "Wyoming" Poverty data
Extracted from Table 21 from US Census Bureau Poverty Data
AVOCado strange issue
#**persistent warning from unknown origin** https://community.rstudio.com/t/persistent-unknown-or-uninitialised-column-warnings/64879
#solution to above is alledgedly: "In any case the suggested approach is to initialize the column"
poverty_rate_data <- read_xls("docs/Poverty/hstpov21.xls", skip=2) #This may cause initialization issue, not easily reproducible (even after restarting R)
head(poverty_rate_data)# A tibble: 6 x 6
`NOTE: Number in thousa… ...2 ...3 ...4 ...5 ...6
<chr> <chr> <chr> <chr> <chr> <chr>
1 2018 <NA> <NA> <NA> <NA> <NA>
2 STATE Total Number "Standard\n… Percent "Standard\ner…
3 Alabama 4877 779 "65" 16 "1.3"
4 Alaska 720 94 "9" 13.1 "1.2"
5 Arizona 7241 929 "80" 12.80000000… "1.1000000000…
6 Arkansas 2912 462 "38" 15.9 "1.3" We can see that this will require some wranlging to make the data more usable.
Violent crime
Violent crime data was obtained from here This data is a bit trickier because of spaces and / in the column names, thus the read_lines() function of the readr package works better than the read_csv() function.
crime_data <- read_lines("docs/Crime/CrimeStatebyState.csv", skip = 2, skip_empty_rows = TRUE)
head(crime_data)[1] "Estimated crime in Alabama"
[2] "\n,,National or state crime,,,,,,,"
[3] "\n,,Violent crime,,,,,,,"
[4] "\nYear,Population,Violent crime total,Murder and nonnegligent Manslaughter,Legacy rape /1,Revised rape /2,Robbery,Aggravated assault,"
[5] "1977, 3690000, 15293, 524, 929,, 3572, 10268 "
[6] "1978, 3742000, 15682, 499, 954,, 3708, 10521 " We can see that this data will also require some wranlging to make it more usable.
Right-to-carry data
This data is extracted from table in Donohue paper. We will use the function pdf_text() of the pdftools package to import the pdf document.
if(!file.exists(here("docs", "w23510.pdf"))){
url <- "https://www.nber.org/papers/w23510.pdf"
utils::download.file(url, here("docs", "w23510.pdf"))
}
DAWpaper <- pdf_text(here("docs", "w23510.pdf"))
head(DAWpaper[1])[1] " NBER WORKING PAPER SERIES\n RIGHT-TO-CARRY LAWS AND VIOLENT CRIME:\n A COMPREHENSIVE ASSESSMENT USING PANEL DATA AND\n A STATE-LEVEL SYNTHETIC CONTROL ANALYSIS\n John J. Donohue\n Abhay Aneja\n Kyle D. Weber\n Working Paper 23510\n http://www.nber.org/papers/w23510\n NATIONAL BUREAU OF ECONOMIC RESEARCH\n 1050 Massachusetts Avenue\n Cambridge, MA 02138\n June 2017, Revised November 2018\nPreviously circulated as \"Right-to-Carry Laws and Violent Crime: A Comprehensive Assessment\nUsing Panel Data and a State-Level Synthetic Controls Analysis.\" We thank Dan Ho, Stefano\nDellaVigna, Rob Tibshirani, Trevor Hastie, StefanWager, Jeff Strnad, and participants at the\n2011 Conference of Empirical Legal Studies (CELS), 2012 American Law and Economics\nAssociation (ALEA) Annual Meeting, 2013 Canadian Law and Economics Association (CLEA)\nAnnual Meeting, 2015 NBER Summer Institute (Crime), and the Stanford Law School faculty\nworkshop for their comments and helpful suggestions. Financial support was provided by\nStanford Law School. We are indebted to Alberto Abadie, Alexis Diamond, and Jens\nHainmueller for their work developing the synthetic control algorithm and programming the Stata\nmodule used in this paper and for their helpful comments. The authors would also like to thank\nAlex Albright, Andrew Baker, Jacob Dorn, Bhargav Gopal, Crystal Huang, Mira Korb, Haksoo\nLee, Isaac Rabbani, Akshay Rao, Vikram Rao, Henrik Sachs and Sidharth Sah who provided\nexcellent research assistance, as well as Addis O’Connor and Alex Chekholko at the Research\nComputing division of Stanford’s Information Technology Services for their technical support.\nThe views expressed herein are those of the author and do not necessarily reflect the views of the\nNational Bureau of Economic Research.\nNBER working papers are circulated for discussion and comment purposes. They have not been\npeer-reviewed or been subject to the review by the NBER Board of Directors that accompanies\nofficial NBER publications.\n© 2017 by John J. Donohue, Abhay Aneja, and Kyle D. Weber. All rights reserved. Short\nsections of text, not to exceed two paragraphs, may be quoted without explicit permission\nprovided that full credit, including © notice, is given to the source.\n"Again, this data will also require quite a bit of wrangling.
Data Wrangling
State FIPS codes
Let’s take a look at our state FIPS data to see if it needs any cleaning or reshaping.
# A tibble: 6 x 4
Region Division `State\n(FIPS)` Name
<chr> <chr> <chr> <chr>
1 1 0 00 Northeast Region
2 1 1 00 New England Division
3 1 1 09 Connecticut
4 1 1 23 Maine
5 1 1 25 Massachusetts
6 1 1 33 New Hampshire We only need the last two columns, but we might want to rename them. The Name variable is vague. The variable with the FIPS code is called State\n(FIPS). To get rid of the new line in this variable name and to change the Name variable to something more informative, we will use the rename() function of the dplyr package. To use this function, we need to list the new name first followed by = and then the existing variable. We can rename multiple variables at the same time by using a comma to separate the variables we are renaming. We will use the select() function also of the dplyr package just to keep these variables, and we will filter out the rows with FIPS values of 00 with the filter() function, agian also part of the dplyr package. we will specify that we want STATEFP values that are not equal to 00 by using this operator: !=. We will also use the double pipe operator %<>% of the magrittr package which allows us to use data as iuput and then reassign it after we peform sum functions using it.
STATE_FIPS %<>%
dplyr::rename( STATEFP = `State\n(FIPS)`,
STATE = Name) %>%
dplyr::select(STATEFP, STATE) %>%
dplyr::filter(STATEFP != "00")
STATE_FIPS# A tibble: 51 x 2
STATEFP STATE
<chr> <chr>
1 09 Connecticut
2 23 Maine
3 25 Massachusetts
4 33 New Hampshire
5 44 Rhode Island
6 50 Vermont
7 34 New Jersey
8 36 New York
9 42 Pennsylvania
10 17 Illinois
# … with 41 more rowsDemographics
1977-1979
Now let’s take a look at our demographic data across the decades that we wish to study. If you have very wide data (meaning it has many columns), one way to view the data so that you can see all of the columns at the same time is to use the glimpse() function of the dplyr package.
Taking a look at the first decade of data, we can see that the Race/Sex Indicator contains two types of data, the race and the sex. This does not follow the tidy data philosophy, where each cell of a tibble should only contain one piece of information. Typically one might think of using the separate() function of the tidyr package to split this variable into two. However, one of the race values is Other races and since this also has a space, this makes separating this data more tricky.
Instead we will use the str_extract() function of the stringr package and the mutate() function of the dplyr package. The “mutate()” will allow us to create new variables, and “str_extract()” function will allow us to match specific patterns and pull out matches to those patterns. Therefore, if the Race/Sex Indicator value is Other races male and if we extract patterns matching either "male" or "female" which we can specify like this pattern = "male|female" then, the value will be male.
First we need to rename the Race/Sex Indicator varaible to not have spaces so that it is compatible with the str_extract() function.
We also want to rename a couple of variables to be simpler and filter the data to only include the years of the data we are interested in, as well as remove some variables that we dont need like the FIPS State Code. We can remove variables by using the select() function with a - minus sign in front of the variable we wish to remove.
Rows: 3,060
Columns: 22
$ `Year of Estimate` <dbl> 1970, 1970, 1970, 1970, 1970, 1970, 1970, 1970, …
$ `FIPS State Code` <chr> "01", "01", "01", "01", "01", "01", "02", "02", …
$ `State Name` <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Ala…
$ `Race/Sex Indicator` <chr> "White male", "White female", "Black male", "Bla…
$ `Under 5 years` <dbl> 105856, 100613, 47403, 47079, 244, 250, 12382, 1…
$ `5 to 9 years` <dbl> 120876, 115194, 55443, 54851, 255, 251, 13888, 1…
$ `10 to 14 years` <dbl> 129091, 122352, 60427, 60065, 253, 245, 13255, 1…
$ `15 to 19 years` <dbl> 119500, 116107, 52921, 55144, 281, 254, 11179, 9…
$ `20 to 24 years` <dbl> 103665, 108513, 29948, 35165, 413, 331, 20237, 1…
$ `25 to 29 years` <dbl> 86538, 88359, 19535, 23662, 239, 302, 12538, 107…
$ `30 to 34 years` <dbl> 74452, 77595, 17196, 22021, 236, 284, 10331, 865…
$ `35 to 39 years` <dbl> 71511, 74941, 16654, 22248, 161, 279, 9548, 7510…
$ `40 to 44 years` <dbl> 75242, 78908, 17564, 24249, 127, 253, 8282, 6353…
$ `45 to 49 years` <dbl> 73874, 78589, 18186, 23028, 108, 148, 6995, 5820…
$ `50 to 54 years` <dbl> 68048, 72481, 17618, 22104, 95, 100, 5609, 4494,…
$ `55 to 59 years` <dbl> 61071, 67699, 18118, 21909, 88, 93, 4029, 2986, …
$ `60 to 64 years` <dbl> 52361, 61065, 16456, 20068, 69, 94, 2392, 1830, …
$ `65 to 69 years` <dbl> 38977, 49685, 14498, 19364, 54, 73, 1292, 965, 2…
$ `70 to 74 years` <dbl> 26767, 37227, 9541, 12509, 70, 66, 602, 496, 8, …
$ `75 to 79 years` <dbl> 17504, 27163, 6030, 8291, 31, 52, 326, 305, 1, 5…
$ `80 to 84 years` <dbl> 9937, 16470, 3485, 5031, 37, 30, 211, 186, 4, 5,…
$ `85 years and over` <dbl> 5616, 10445, 2448, 4035, 76, 29, 143, 126, 19, 4…dem_77_79 <- dem_77_79 %>%
rename("race_sex" =`Race/Sex Indicator`) %>%
mutate(SEX = str_extract(race_sex, "male|female"),
RACE = str_extract(race_sex, "Black|White|Other"))%>%
select(-`FIPS State Code`, -`race_sex`) %>%
rename("YEAR" = `Year of Estimate`,
"STATE" = `State Name`) %>%
filter(YEAR %in% 1977:1979)
glimpse(dem_77_79)Rows: 918
Columns: 22
$ YEAR <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1…
$ STATE <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alab…
$ `Under 5 years` <dbl> 98814, 94595, 46201, 45784, 590, 621, 14316, 1353…
$ `5 to 9 years` <dbl> 113365, 107395, 50097, 49329, 672, 660, 14621, 13…
$ `10 to 14 years` <dbl> 123107, 116182, 54925, 53955, 677, 653, 14795, 13…
$ `15 to 19 years` <dbl> 135343, 130433, 58468, 59926, 674, 605, 15207, 13…
$ `20 to 24 years` <dbl> 126053, 125352, 43898, 51433, 722, 773, 20106, 16…
$ `25 to 29 years` <dbl> 111547, 112471, 31014, 36648, 638, 835, 20444, 18…
$ `30 to 34 years` <dbl> 100674, 101543, 22528, 26694, 571, 766, 17514, 15…
$ `35 to 39 years` <dbl> 81038, 83369, 17473, 22213, 498, 586, 13098, 1069…
$ `40 to 44 years` <dbl> 75042, 77793, 16446, 22146, 356, 479, 10067, 7935…
$ `45 to 49 years` <dbl> 76296, 79753, 16578, 22576, 295, 432, 8460, 6848,…
$ `50 to 54 years` <dbl> 74844, 81079, 17117, 23028, 206, 326, 7268, 5914,…
$ `55 to 59 years` <dbl> 67785, 75905, 16437, 21435, 166, 213, 5398, 4485,…
$ `60 to 64 years` <dbl> 58853, 69406, 16276, 21075, 145, 174, 3349, 2708,…
$ `65 to 69 years` <dbl> 48848, 62430, 15837, 21126, 107, 173, 1714, 1468,…
$ `70 to 74 years` <dbl> 34475, 50075, 11450, 16028, 90, 138, 915, 928, 22…
$ `75 to 79 years` <dbl> 20977, 34027, 7601, 10825, 53, 106, 500, 493, 10,…
$ `80 to 84 years` <dbl> 10831, 21483, 3896, 6272, 25, 49, 237, 268, 4, 7,…
$ `85 years and over` <dbl> 6683, 15729, 2667, 5426, 33, 41, 153, 211, 11, 6,…
$ SEX <chr> "male", "female", "male", "female", "male", "fema…
$ RACE <chr> "White", "White", "Black", "Black", "Other", "Oth…That’s looking pretty good! We also want to take all the age group variabels and make one variable that is the age group name and one that is the value of the population count for that age group. To do this we will use the pivot_longer() function of the tidyr package. To use this function, we need to use the cols argument to indicate which columns we want to pivot. We also name the new variables we will create with the names_to and values_to arguments. The names_to will be the name of the variable that will identify each age group and values_to will be the name of the variable that contains the corresponding population values.
dem_77_79 <- dem_77_79 %>%
pivot_longer(cols=contains("years"),
names_to = "AGE_GROUP",
values_to = "SUB_POP")
glimpse(dem_77_79)Rows: 16,524
Columns: 6
$ YEAR <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977,…
$ STATE <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alabama", "Ala…
$ SEX <chr> "male", "male", "male", "male", "male", "male", "male", "ma…
$ RACE <chr> "White", "White", "White", "White", "White", "White", "Whit…
$ AGE_GROUP <chr> "Under 5 years", "5 to 9 years", "10 to 14 years", "15 to 1…
$ SUB_POP <dbl> 98814, 113365, 123107, 135343, 126053, 111547, 100674, 8103…We also want to get data about the total population for the state for each year.
To do so we can sum all the values for the SUB_POP variable that we just created. To do this we can use the group_by and summarize() functions of the dplyr package. The group_by() function specifies how we want to calculate our sum, that we would like to calculate it for each year and each state individually. Thus, all the values that have the same STATE and YEAR values will be summed together, rather than summing using all of the values in the SUB_POP variable. The .groups argument allows us to remove the grouping after we peform the calculation with summarize().
pop_77_79 <- dem_77_79 %>%
group_by(YEAR, STATE) %>%
summarize("TOT_POP" = sum(SUB_POP), .groups = "drop")
pop_77_79 # A tibble: 153 x 3
YEAR STATE TOT_POP
<dbl> <chr> <dbl>
1 1977 Alabama 3782571
2 1977 Alaska 397220
3 1977 Arizona 2427296
4 1977 Arkansas 2207195
5 1977 California 22350332
6 1977 Colorado 2696179
7 1977 Connecticut 3088745
8 1977 Delaware 594815
9 1977 District of Columbia 681766
10 1977 Florida 8888806
# … with 143 more rowsNow we will add the population value to the demographic tibble using the left_join() function of the dplyr package. It is imporant that we specify how this should be done, that the YEAR and STATE variable vlaues should match eachother. This will place the dem_77_79 variables to the left of the pop_77_79 data.
# A tibble: 16,524 x 7
YEAR STATE SEX RACE AGE_GROUP SUB_POP TOT_POP
<dbl> <chr> <chr> <chr> <chr> <dbl> <dbl>
1 1977 Alabama male White Under 5 years 98814 3782571
2 1977 Alabama male White 5 to 9 years 113365 3782571
3 1977 Alabama male White 10 to 14 years 123107 3782571
4 1977 Alabama male White 15 to 19 years 135343 3782571
5 1977 Alabama male White 20 to 24 years 126053 3782571
6 1977 Alabama male White 25 to 29 years 111547 3782571
7 1977 Alabama male White 30 to 34 years 100674 3782571
8 1977 Alabama male White 35 to 39 years 81038 3782571
9 1977 Alabama male White 40 to 44 years 75042 3782571
10 1977 Alabama male White 45 to 49 years 76296 3782571
# … with 16,514 more rowsWe will also calculate the percentage that each group makes up of the total population, by dividing the SUB_POP by the TOT_POP and multiplying by 100 using the mutate() function. we will also remove the other population variables.
dem_77_79 <- dem_77_79 %>%
mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
select(-SUB_POP, -TOT_POP)
dem_77_79# A tibble: 16,524 x 6
YEAR STATE SEX RACE AGE_GROUP PERC_SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1977 Alabama male White Under 5 years 2.61
2 1977 Alabama male White 5 to 9 years 3.00
3 1977 Alabama male White 10 to 14 years 3.25
4 1977 Alabama male White 15 to 19 years 3.58
5 1977 Alabama male White 20 to 24 years 3.33
6 1977 Alabama male White 25 to 29 years 2.95
7 1977 Alabama male White 30 to 34 years 2.66
8 1977 Alabama male White 35 to 39 years 2.14
9 1977 Alabama male White 40 to 44 years 1.98
10 1977 Alabama male White 45 to 49 years 2.02
# … with 16,514 more rows1980-1989
For this decade each year is a separate tibble and they are combined as a list.
[1] "list"So the first thing we need to do is combine each tibble of the list together. We can do that using the bind_rows() function of dplyr which appends the data together based on the presence of columns with the same name in the different tibbles. We will use the map_df() function of the purrr package to allow us to do this across each tibble in our list.
Rows: 188,460
Columns: 21
$ `Year of Estimate` <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 198…
$ `FIPS State and County Codes` <chr> "01001", "01001", "01001", "01001", "01…
$ `Race/Sex Indicator` <chr> "White male", "White female", "Black ma…
$ `Under 5 years` <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 6…
$ `5 to 9 years` <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, …
$ `10 to 14 years` <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614…
$ `15 to 19 years` <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841…
$ `20 to 24 years` <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, …
$ `25 to 29 years` <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, …
$ `30 to 34 years` <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, …
$ `35 to 39 years` <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202,…
$ `40 to 44 years` <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, …
$ `45 to 49 years` <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, …
$ `50 to 54 years` <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 2…
$ `55 to 59 years` <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 1…
$ `60 to 64 years` <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 1…
$ `65 to 69 years` <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 1…
$ `70 to 74 years` <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 16…
$ `75 to 79 years` <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 1…
$ `80 to 84 years` <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67…
$ `85 years and over` <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65,…Great! Now our data is all together.
Now we will wrangle the data similarly to the previous decade.
dem_80_89 <- dem_80_89 %>%
rename("race_sex" =`Race/Sex Indicator`) %>%
mutate(SEX = str_extract(race_sex, "male|female"),
RACE = str_extract(race_sex, "Black|White|Other"))%>%
select( -`race_sex`) %>%
rename("YEAR" = `Year of Estimate`)
glimpse(dem_80_89)Rows: 188,460
Columns: 22
$ YEAR <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 198…
$ `FIPS State and County Codes` <chr> "01001", "01001", "01001", "01001", "01…
$ `Under 5 years` <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 6…
$ `5 to 9 years` <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, …
$ `10 to 14 years` <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614…
$ `15 to 19 years` <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841…
$ `20 to 24 years` <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, …
$ `25 to 29 years` <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, …
$ `30 to 34 years` <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, …
$ `35 to 39 years` <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202,…
$ `40 to 44 years` <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, …
$ `45 to 49 years` <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, …
$ `50 to 54 years` <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 2…
$ `55 to 59 years` <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 1…
$ `60 to 64 years` <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 1…
$ `65 to 69 years` <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 1…
$ `70 to 74 years` <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 16…
$ `75 to 79 years` <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 1…
$ `80 to 84 years` <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67…
$ `85 years and over` <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65,…
$ SEX <chr> "male", "female", "male", "female", "ma…
$ RACE <chr> "White", "White", "Black", "Black", "Ot…Notice that this time the state information is based on the numeric FIPS value. We want only the first two values, as the rest indicate the county. We can use the str_sub() function of the stringr package for this. We will specify that we want to start at the first position and end at the second. Just like str_extract() we need to rename this variable first so that it is compatible.
dem_80_89 %<>%
rename("STATEFP_temp" = "FIPS State and County Codes") %>%
mutate(STATEFP = str_sub(STATEFP_temp, start = 1, end = 2)) %>%
left_join(STATE_FIPS, by = "STATEFP") %>%
dplyr::select(-STATEFP)
glimpse(dem_80_89)Rows: 188,460
Columns: 23
$ YEAR <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 1980, 1980, 1…
$ STATEFP_temp <chr> "01001", "01001", "01001", "01001", "01001", "010…
$ `Under 5 years` <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 672, 645, 3…
$ `5 to 9 years` <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, 740, 680, …
$ `10 to 14 years` <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614, 644, 670…
$ `15 to 19 years` <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841, 711, 762…
$ `20 to 24 years` <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, 516, 601, …
$ `25 to 29 years` <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, 414, 469, …
$ `30 to 34 years` <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, 303, 352, …
$ `35 to 39 years` <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202, 224, 260,…
$ `40 to 44 years` <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, 206, 288, …
$ `45 to 49 years` <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, 219, 236, …
$ `50 to 54 years` <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 203, 261, 7…
$ `55 to 59 years` <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 178, 219, 8…
$ `60 to 64 years` <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 171, 209, 8…
$ `65 to 69 years` <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 170, 232, 6…
$ `70 to 74 years` <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 164, 182, 4,…
$ `75 to 79 years` <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 129, 3, 6, …
$ `80 to 84 years` <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67, 1, 2, 56…
$ `85 years and over` <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65, 1, 1, 30,…
$ SEX <chr> "male", "female", "male", "female", "male", "fema…
$ RACE <chr> "White", "White", "Black", "Black", "Other", "Oth…
$ STATE <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alab…AVOCADO - why do we group by age_group sex and race this time but not with the last decade?
dem_80_89 %<>%
pivot_longer(cols=contains("years"),
names_to = "AGE_GROUP",
values_to = "SUB_POP_temp") %>%
group_by(YEAR, STATE, AGE_GROUP, SEX, RACE) %>%
summarise(SUB_POP = sum(SUB_POP_temp), .groups="drop")
dem_80_89# A tibble: 55,080 x 6
YEAR STATE AGE_GROUP SEX RACE SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1980 Alabama 10 to 14 years female Black 50108
2 1980 Alabama 10 to 14 years female Other 805
3 1980 Alabama 10 to 14 years female White 109066
4 1980 Alabama 10 to 14 years male Black 50768
5 1980 Alabama 10 to 14 years male Other 826
6 1980 Alabama 10 to 14 years male White 115988
7 1980 Alabama 15 to 19 years female Black 58428
8 1980 Alabama 15 to 19 years female Other 743
9 1980 Alabama 15 to 19 years female White 126783
10 1980 Alabama 15 to 19 years male Black 56808
# … with 55,070 more rowspop_80_89 <- dem_80_89 %>%
group_by(YEAR, STATE) %>%
summarise("TOT_POP" = sum(SUB_POP), .groups = "drop")
dem_80_89 <- dem_80_89 %>%
left_join(pop_80_89, by = c("YEAR","STATE")) %>%
mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
dplyr::select(-SUB_POP, -TOT_POP)
dem_80_89# A tibble: 55,080 x 6
YEAR STATE AGE_GROUP SEX RACE PERC_SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1980 Alabama 10 to 14 years female Black 1.28
2 1980 Alabama 10 to 14 years female Other 0.0206
3 1980 Alabama 10 to 14 years female White 2.80
4 1980 Alabama 10 to 14 years male Black 1.30
5 1980 Alabama 10 to 14 years male Other 0.0212
6 1980 Alabama 10 to 14 years male White 2.97
7 1980 Alabama 15 to 19 years female Black 1.50
8 1980 Alabama 15 to 19 years female Other 0.0191
9 1980 Alabama 15 to 19 years female White 3.25
10 1980 Alabama 15 to 19 years male Black 1.46
# … with 55,070 more rows1990-1999
Rows: 43,870
Columns: 19
$ Year <dbl> NA, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 19…
$ e <chr> NA, "01", "01", "01", "01", "01", "01", "01", "01", "01", "0…
$ Age <dbl> NA, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16…
$ Male <dbl> NA, 20406, 19393, 18990, 19246, 19502, 19560, 19091, 19605, …
$ Female <dbl> NA, 19101, 18114, 18043, 17786, 18366, 18386, 18047, 18316, …
$ Male_1 <dbl> NA, 9794, 9475, 9097, 9002, 9076, 9169, 8919, 9219, 9247, 10…
$ Female_1 <dbl> NA, 9414, 9247, 8837, 8701, 8989, 9093, 8736, 9192, 9108, 97…
$ Male_2 <dbl> NA, 103, 87, 97, 94, 108, 128, 160, 178, 166, 205, 194, 179,…
$ Female_2 <dbl> NA, 90, 93, 100, 115, 114, 130, 134, 162, 155, 193, 185, 202…
$ Male_3 <dbl> NA, 192, 146, 175, 150, 168, 170, 183, 171, 136, 177, 169, 1…
$ Female_3 <dbl> NA, 170, 182, 160, 157, 178, 158, 173, 177, 185, 179, 171, 1…
$ Male_4 <dbl> NA, 223, 190, 198, 186, 190, 210, 188, 178, 182, 221, 194, 1…
$ Female_4 <dbl> NA, 220, 196, 173, 191, 190, 170, 172, 179, 173, 166, 175, 1…
$ Male_5 <dbl> NA, 47, 41, 32, 35, 36, 30, 28, 27, 29, 32, 31, 33, 34, 32, …
$ Female_5 <dbl> NA, 45, 47, 41, 30, 26, 37, 23, 35, 31, 28, 38, 22, 39, 29, …
$ Male_6 <dbl> NA, 1, 2, 1, 9, 5, 8, 2, 4, 6, 6, 0, 1, 9, 6, 7, 5, 2, 2, 4,…
$ Female_6 <dbl> NA, 8, 0, 2, 1, 4, 5, 3, 4, 4, 3, 4, 2, 2, 7, 0, 2, 2, 1, 6,…
$ Male_7 <dbl> NA, 5, 7, 2, 3, 5, 11, 2, 7, 12, 10, 7, 5, 6, 5, 6, 6, 2, 11…
$ Female_7 <dbl> NA, 5, 5, 5, 3, 14, 6, 7, 6, 3, 11, 5, 5, 7, 8, 6, 6, 7, 3, …colnames(dem_90_99) <- c("YEAR",
"STATEFP",
"Age",
"NH_W_M",
"NH_W_F",
"NH_B_M",
"NH_B_F",
"NH_AIAN_M",
"NH_AIAN_F",
"NH_API_M",
"NH_API_F",
"H_W_M",
"H_W_F",
"H_B_M",
"H_B_F",
"H_AIAN_M",
"H_AIAN_F",
"H_API_M",
"H_API_F")
dim(dem_90_99)[1] 43870 19dem_90_99 <- dem_90_99 %>%
mutate(W_M = NH_W_M + H_W_M,
W_F = NH_W_F + H_W_F,
B_M = NH_B_M + H_B_M,
B_F = NH_B_F + H_B_F,
AIAN_M = NH_AIAN_M + H_AIAN_M,
AIAN_F = NH_AIAN_F + H_AIAN_F,
API_M = NH_API_M + H_API_M,
API_F = NH_API_F + H_API_F,
n_na = rowSums(is.na(.))) %>%
dplyr::select(-starts_with("NH_"), -starts_with("H_"))
dem_90_99 %>%
group_by(n_na) %>%
tally()# A tibble: 2 x 2
n_na n
<dbl> <int>
1 0 43860
2 19 10empty_rows_na <- dem_90_99 %>%
group_by(n_na) %>%
tally() %>%
filter(n_na != 0) %>%
pull(n_na)
dem_90_99 <- dem_90_99 %>%
filter(n_na != empty_rows_na) %>%
dplyr::select(-n_na)
sapply(dem_90_99, class) YEAR STATEFP Age W_M W_F B_M
"numeric" "character" "numeric" "numeric" "numeric" "numeric"
B_F AIAN_M AIAN_F API_M API_F
"numeric" "numeric" "numeric" "numeric" "numeric" 10 to 14 years 15 to 19 years 20 to 24 years 25 to 29 years
3060 3060 3060 3060
30 to 34 years 35 to 39 years 40 to 44 years 45 to 49 years
3060 3060 3060 3060
5 to 9 years 50 to 54 years 55 to 59 years 60 to 64 years
3060 3060 3060 3060
65 to 69 years 70 to 74 years 75 to 79 years 80 to 84 years
3060 3060 3060 3060
85 years and over Under 5 years
3060 3060 dem_90_99 <- dem_90_99 %>%
mutate(AGE_GROUP = cut(Age,
breaks = seq(0,90, by=5),
right = FALSE,
labels = c("Under 5 years",
"5 to 9 years",
"10 to 14 years",
"15 to 19 years",
"20 to 24 years",
"25 to 29 years",
"30 to 34 years",
"35 to 39 years",
"40 to 44 years",
"45 to 49 years",
"50 to 54 years",
"55 to 59 years",
"60 to 64 years",
"65 to 69 years",
"70 to 74 years",
"75 to 79 years",
"80 to 84 years",
"85 years and over")
)) %>%
dplyr::select(-Age) %>%
mutate(AGE_GROUP = as.character(AGE_GROUP))
sapply(dem_90_99, class) YEAR STATEFP W_M W_F B_M B_F
"numeric" "character" "numeric" "numeric" "numeric" "numeric"
AIAN_M AIAN_F API_M API_F AGE_GROUP
"numeric" "numeric" "numeric" "numeric" "character" dem_90_99 <- dem_90_99 %>%
group_by(YEAR, STATEFP, AGE_GROUP) %>%
summarise_at(vars(starts_with("W_"),
starts_with("B_"),
starts_with("AIAN_"),
starts_with("API_")), sum) %>%
ungroup() %>%
pivot_longer(cols = c(starts_with("W_"),
starts_with("B_"),
starts_with("AIAN_"),
starts_with("API_")),
names_to = "RACE",
values_to = "SUB_POP")
dem_90_99 <- dem_90_99 %>%
mutate(SEX = case_when(str_detect(RACE, "_M") ~ "Male",
TRUE ~ "Female"),
RACE = case_when(str_detect(RACE, "W_") ~ "White",
str_detect(RACE, "B_") ~ "Black",
TRUE ~ "Other")) %>%
left_join(STATE_FIPS, by = "STATEFP") %>%
dplyr::select(-STATEFP)
pop_90_99 <- dem_90_99 %>%
group_by(YEAR, STATE) %>%
summarise(TOT_POP = sum(SUB_POP), .groups = "drop")
dem_90_99 <- dem_90_99 %>%
left_join(pop_90_99, by=c("YEAR", "STATE")) %>%
mutate(PERC_SUB_POP = SUB_POP*100/TOT_POP) %>%
dplyr::select(-SUB_POP, -TOT_POP)2000-2010
Rows: 62,244
Columns: 21
$ REGION <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ DIVISION <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ STATE <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ NAME <chr> "United States", "United States", "United States", …
$ SEX <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ ORIGIN <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ RACE <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ AGEGRP <dbl> 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 1…
$ ESTIMATESBASE2000 <dbl> 281424600, 19176154, 20549855, 20528425, 20218782, …
$ POPESTIMATE2000 <dbl> 282162411, 19178293, 20463852, 20637696, 20294955, …
$ POPESTIMATE2001 <dbl> 284968955, 19298217, 20173362, 20978678, 20456284, …
$ POPESTIMATE2002 <dbl> 287625193, 19429192, 19872417, 21261421, 20610370, …
$ POPESTIMATE2003 <dbl> 290107933, 19592446, 19620851, 21415353, 20797166, …
$ POPESTIMATE2004 <dbl> 292805298, 19785885, 19454237, 21411680, 21102552, …
$ POPESTIMATE2005 <dbl> 295516599, 19917400, 19389067, 21212579, 21486214, …
$ POPESTIMATE2006 <dbl> 298379912, 19938883, 19544688, 21033138, 21807709, …
$ POPESTIMATE2007 <dbl> 301231207, 20125962, 19714611, 20841042, 22067816, …
$ POPESTIMATE2008 <dbl> 304093966, 20271127, 19929602, 20706655, 22210880, …
$ POPESTIMATE2009 <dbl> 306771529, 20244518, 20182499, 20660564, 22192810, …
$ CENSUS2010POP <dbl> 308745538, 20201362, 20348657, 20677194, 22040343, …
$ POPESTIMATE2010 <dbl> 309349689, 20200529, 20382409, 20694011, 21959087, …dem_00_10 <- dem_00_10 %>%
dplyr::select(-ESTIMATESBASE2000,-CENSUS2010POP) %>%
filter(REGION != 0,
DIVISION != 0,
SEX != 0,
ORIGIN == 0,
RACE != 0,
AGEGRP != 0,
STATE != 0) %>%
dplyr::select(-REGION, -DIVISION, -ORIGIN, -STATE) %>%
rename("STATE" = NAME,
"AGE_GROUP" = AGEGRP) %>%
mutate(SEX = factor(SEX,
levels = 1:2,
labels = c("Male",
"Female")),
RACE = factor(RACE,
levels = 1:6,
labels = c("White",
"Black",
rep("Other",4))),
AGE_GROUP = factor(AGE_GROUP,
levels = 1:18,
labels = c("Under 5 years",
"5 to 9 years",
"10 to 14 years",
"15 to 19 years",
"20 to 24 years",
"25 to 29 years",
"30 to 34 years",
"35 to 39 years",
"40 to 44 years",
"45 to 49 years",
"50 to 54 years",
"55 to 59 years",
"60 to 64 years",
"65 to 69 years",
"70 to 74 years",
"75 to 79 years",
"80 to 84 years",
"85 years and over"))) %>%
mutate(SEX = as.character(SEX),
RACE = as.character(RACE),
AGE_GROUP = as.character(AGE_GROUP))
colnames(dem_00_10) [1] "STATE" "SEX" "RACE" "AGE_GROUP"
[5] "POPESTIMATE2000" "POPESTIMATE2001" "POPESTIMATE2002" "POPESTIMATE2003"
[9] "POPESTIMATE2004" "POPESTIMATE2005" "POPESTIMATE2006" "POPESTIMATE2007"
[13] "POPESTIMATE2008" "POPESTIMATE2009" "POPESTIMATE2010"dem_00_10 <- dem_00_10 %>%
pivot_longer(cols=contains("ESTIMATE"),
names_to = "YEAR",
values_to = "SUB_POP")
dem_00_10 <- dem_00_10 %>%
mutate(YEAR = str_sub(YEAR, start=-4)) %>%
mutate(YEAR = as.numeric(YEAR))
sapply(dem_00_10, class) STATE SEX RACE AGE_GROUP YEAR SUB_POP
"character" "character" "character" "character" "numeric" "numeric" pop_00_10 <- dem_00_10 %>%
group_by(YEAR, STATE) %>%
summarise(TOT_POP = sum(SUB_POP), .groups = "drop")
dem_00_10 %>%
left_join(pop_00_10, by=c("YEAR", "STATE")) %>%
group_by(YEAR, STATE) %>%
mutate(PERC_SUB_POP = SUB_POP*100/TOT_POP) %>%
summarise(perc_tot = sum(PERC_SUB_POP), .groups = "drop") %>%
mutate(poss_error = case_when(abs(perc_tot - 100) > 0 ~ TRUE,
TRUE ~ FALSE)) %>%
group_by(poss_error) %>%
tally()# A tibble: 1 x 2
poss_error n
<lgl> <int>
1 FALSE 561Combining demographic data
[1] TRUE[1] TRUE[1] TRUE# A tibble: 6 x 6
YEAR STATE SEX RACE AGE_GROUP PERC_SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1977 Alabama male White Under 5 years 2.61
2 1977 Alabama male White 5 to 9 years 3.00
3 1977 Alabama male White 10 to 14 years 3.25
4 1977 Alabama male White 15 to 19 years 3.58
5 1977 Alabama male White 20 to 24 years 3.33
6 1977 Alabama male White 25 to 29 years 2.95# A tibble: 6 x 6
YEAR STATE AGE_GROUP SEX RACE PERC_SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1980 Alabama 10 to 14 years female Black 1.28
2 1980 Alabama 10 to 14 years female Other 0.0206
3 1980 Alabama 10 to 14 years female White 2.80
4 1980 Alabama 10 to 14 years male Black 1.30
5 1980 Alabama 10 to 14 years male Other 0.0212
6 1980 Alabama 10 to 14 years male White 2.97 # A tibble: 6 x 6
YEAR AGE_GROUP RACE SEX STATE PERC_SUB_POP
<dbl> <chr> <chr> <chr> <chr> <dbl>
1 1990 10 to 14 years White Male Alabama 2.46
2 1990 10 to 14 years White Female Alabama 2.33
3 1990 10 to 14 years Black Male Alabama 1.21
4 1990 10 to 14 years Black Female Alabama 1.20
5 1990 10 to 14 years Other Male Alabama 0.0239
6 1990 10 to 14 years Other Female Alabama 0.0235# A tibble: 6 x 6
STATE SEX RACE AGE_GROUP YEAR PERC_SUB_POP
<chr> <chr> <chr> <chr> <dbl> <dbl>
1 Alabama Male White Under 5 years 2000 2.24
2 Alabama Male White Under 5 years 2001 2.24
3 Alabama Male White Under 5 years 2002 2.22
4 Alabama Male White Under 5 years 2003 2.21
5 Alabama Male White Under 5 years 2004 2.20
6 Alabama Male White Under 5 years 2005 2.20[1] 18[1] 18[1] 18[1] 18dem <- bind_rows(dem_77_79,
dem_80_89,
dem_90_99,
dem_00_10)
dem %>%
filter(RACE == "Other") %>%
group_by(YEAR) %>%
tally() %>%
summarise(years_data = n())# A tibble: 1 x 1
years_data
<int>
1 34[1] 34DONOHUE_AGE_GROUPS <- c("15 to 19 years",
"20 to 24 years",
"25 to 29 years",
"30 to 34 years",
"35 to 39 years")
DONOHUE_RACE <- c("White",
"Black",
"Other")
DONOHUE_SEX <- c("Male")
dem_DONOHUE <- dem %>%
filter(AGE_GROUP %in% DONOHUE_AGE_GROUPS,
RACE %in% DONOHUE_RACE,
SEX %in% DONOHUE_SEX) %>%
mutate(AGE_GROUP = fct_collapse(AGE_GROUP, "20 to 39 years"=c("20 to 24 years",
"25 to 29 years",
"30 to 34 years",
"35 to 39 years"))) %>%
mutate(AGE_GROUP = str_replace_all(AGE_GROUP," ","_")) %>%
group_by(YEAR, STATE, RACE, SEX, AGE_GROUP) %>%
summarise(PERC_SUB_POP = sum(PERC_SUB_POP), .groups = "drop") %>%
unite(col = "VARIABLE", RACE, SEX, AGE_GROUP, sep = "_") %>%
rename("VALUE"=PERC_SUB_POP)
LOTT_AGE_GROUPS_NULL <- c("Under 5 years",
"5 to 9 years")
LOTT_RACE <- c("White",
"Black",
"Other")
LOTT_SEX <- c("Male",
"Female")
dem_LOTT <- dem %>%
filter(!(AGE_GROUP %in% LOTT_AGE_GROUPS_NULL),
RACE %in% LOTT_RACE,
SEX %in% LOTT_SEX) %>%
mutate(AGE_GROUP = fct_collapse(AGE_GROUP,
"10 to 19 years"=c("10 to 14 years",
"15 to 19 years"),
"20 to 29 years"=c("20 to 24 years",
"25 to 29 years"),
"30 to 39 years"=c("30 to 34 years",
"35 to 39 years"),
"40 to 49 years"=c("40 to 44 years",
"45 to 49 years"),
"50 to 64 years"=c("50 to 54 years",
"55 to 59 years",
"60 to 64 years"),
"65 years and over"=c("65 to 69 years",
"70 to 74 years",
"75 to 79 years",
"80 to 84 years",
"85 years and over"))) %>%
mutate(AGE_GROUP = str_replace_all(AGE_GROUP," ","_")) %>%
group_by(YEAR, STATE, RACE, SEX, AGE_GROUP) %>%
summarise(PERC_SUB_POP = sum(PERC_SUB_POP), .groups = "drop") %>%
unite(col = "VARIABLE", RACE, SEX, AGE_GROUP, sep = "_") %>%
rename("VALUE"=PERC_SUB_POP)
dim(expand.grid(c(1:6), c(7:8), c(9:10)))[1][1] 24[1] TRUE[1] TRUE[1] TRUE# A tibble: 6 x 3
YEAR STATE TOT_POP
<dbl> <chr> <dbl>
1 1977 Alabama 3782571
2 1977 Alaska 397220
3 1977 Arizona 2427296
4 1977 Arkansas 2207195
5 1977 California 22350332
6 1977 Colorado 2696179# A tibble: 6 x 3
YEAR STATE TOT_POP
<dbl> <chr> <dbl>
1 1980 Alabama 3899671
2 1980 Alaska 404680
3 1980 Arizona 2735840
4 1980 Arkansas 2288809
5 1980 California 23792840
6 1980 Colorado 2909545# A tibble: 6 x 3
YEAR STATE TOT_POP
<dbl> <chr> <dbl>
1 1990 Alabama 4048508
2 1990 Alaska 553120
3 1990 Arizona 3679056
4 1990 Arkansas 2354343
5 1990 California 29950111
6 1990 Colorado 3303862# A tibble: 6 x 3
YEAR STATE TOT_POP
<dbl> <chr> <dbl>
1 2000 Alabama 4452173
2 2000 Alaska 627963
3 2000 Arizona 5160586
4 2000 Arkansas 2678588
5 2000 California 33987977
6 2000 Colorado 4326921population_data <- bind_rows(pop_77_79,
pop_80_89,
pop_90_99,
pop_00_10)
population_data %>%
group_by(YEAR) %>%
tally() %>%
print(n = dim(.)[1])# A tibble: 34 x 2
YEAR n
<dbl> <int>
1 1977 51
2 1978 51
3 1979 51
4 1980 51
5 1981 51
6 1982 51
7 1983 51
8 1984 51
9 1985 51
10 1986 51
11 1987 51
12 1988 51
13 1989 51
14 1990 51
15 1991 51
16 1992 51
17 1993 51
18 1994 51
19 1995 51
20 1996 51
21 1997 51
22 1998 51
23 1999 51
24 2000 51
25 2001 51
26 2002 51
27 2003 51
28 2004 51
29 2005 51
30 2006 51
31 2007 51
32 2008 51
33 2009 51
34 2010 51Police staffing
[1] "data_year" "ori" "pub_agency_name"
[4] "pub_agency_unit" "state_abbr" "division_name"
[7] "region_name" "county_name" "agency_type_name"
[10] "population_group_desc" "population" "male_officer_ct"
[13] "male_civilian_ct" "male_total_ct" "female_officer_ct"
[16] "female_civilian_ct" "female_total_ct" "officer_ct"
[19] "civilian_ct" "total_pe_ct" "pe_ct_per_1000" ps_data <- ps_data %>%
filter(data_year >= 1977,
data_year <= 2014) %>%
mutate(male_total_ct = case_when(is.na(male_total_ct) ~ 0,
TRUE ~ male_total_ct),
female_total_ct = case_when(is.na(female_total_ct) ~ 0,
TRUE ~ female_total_ct)) %>%
mutate(officer_total = male_total_ct + female_total_ct) %>%
dplyr::select(data_year,
pub_agency_name,
state_abbr,
officer_total)
ps_data <- ps_data %>%
group_by(data_year, state_abbr) %>%
summarise(officer_state_total=sum(officer_total), .groups = "drop")
ps_data %>%
group_by(state_abbr) %>%
tally() %>%
print(n = dim(.)[1])# A tibble: 59 x 2
state_abbr n
<chr> <int>
1 AK 38
2 AL 38
3 AR 38
4 AS 38
5 AZ 38
6 CA 38
7 CO 38
8 CT 38
9 CZ 38
10 DC 38
11 DE 38
12 FL 38
13 FS 38
14 GA 38
15 GM 38
16 HI 38
17 IA 38
18 ID 38
19 IL 38
20 IN 38
21 KS 38
22 KY 38
23 LA 38
24 MA 38
25 MD 38
26 ME 38
27 MI 38
28 MN 38
29 MO 38
30 MP 38
31 MS 38
32 MT 38
33 NB 38
34 NC 38
35 ND 38
36 NH 38
37 NJ 38
38 NM 38
39 NV 38
40 NY 38
41 OH 38
42 OK 38
43 OR 38
44 OT 38
45 PA 38
46 PR 38
47 RI 38
48 SC 38
49 SD 38
50 TN 38
51 TX 38
52 UT 38
53 VA 38
54 VI 38
55 VT 38
56 WA 38
57 WI 38
58 WV 38
59 WY 38# NB is Nebraska. This was changed to NE to avoid confusions with NB in Canada. This dataset uses NB
state_of_interest_NULL <- c("AS",
"GM",
"CZ",
"FS",
"MP",
"OT",
"PR",
"VI")
state_abb_df <- as.data.frame(cbind(state.abb, state.name))
colnames(state_abb_df) <- c("state_abbr", "STATE")
print(state_abb_df) state_abbr STATE
1 AL Alabama
2 AK Alaska
3 AZ Arizona
4 AR Arkansas
5 CA California
6 CO Colorado
7 CT Connecticut
8 DE Delaware
9 FL Florida
10 GA Georgia
11 HI Hawaii
12 ID Idaho
13 IL Illinois
14 IN Indiana
15 IA Iowa
16 KS Kansas
17 KY Kentucky
18 LA Louisiana
19 ME Maine
20 MD Maryland
21 MA Massachusetts
22 MI Michigan
23 MN Minnesota
24 MS Mississippi
25 MO Missouri
26 MT Montana
27 NE Nebraska
28 NV Nevada
29 NH New Hampshire
30 NJ New Jersey
31 NM New Mexico
32 NY New York
33 NC North Carolina
34 ND North Dakota
35 OH Ohio
36 OK Oklahoma
37 OR Oregon
38 PA Pennsylvania
39 RI Rhode Island
40 SC South Carolina
41 SD South Dakota
42 TN Tennessee
43 TX Texas
44 UT Utah
45 VT Vermont
46 VA Virginia
47 WA Washington
48 WV West Virginia
49 WI Wisconsin
50 WY Wyomingstate_abb_df <- state_abb_df %>%
add_row(state_abbr="DC",
STATE="District of Columbia")
denominator_temp <- population_data %>%
dplyr::select(-VARIABLE) %>%
rename("Population_temp"=VALUE)
ps_data <- ps_data %>%
filter(!(state_abbr %in% state_of_interest_NULL)) %>%
mutate(state_abbr = case_when(state_abbr == "NB" ~ "NE",
TRUE ~ state_abbr)) %>%
left_join(state_abb_df, by = "state_abbr") %>%
dplyr::select(-state_abbr) %>%
rename(YEAR = "data_year",
VALUE = "officer_state_total") %>%
mutate(VARIABLE = "officer_state_total") %>%
left_join(denominator_temp, by=c("STATE","YEAR")) %>%
mutate(VALUE = (VALUE*100000) / Population_temp) %>%
mutate(VALUE = lag(VALUE)) %>%
mutate(VARIABLE = "police_per_100k_lag") %>%
dplyr::select(-Population_temp)Unemployment
# A tibble: 1 x 14
Year Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
<dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
1 2020 3.2 2.9 3 13.3 NA NA NA NA NA NA NA NA
# … with 1 more variable: Annual <dbl> [1] "STATE" "Year" "Jan" "Feb" "Mar" "Apr" "May" "Jun"
[9] "Jul" "Aug" "Sep" "Oct" "Nov" "Dec" "Annual" STATE Year Jan Feb Mar Apr
"character" "numeric" "numeric" "numeric" "numeric" "numeric"
May Jun Jul Aug Sep Oct
"numeric" "numeric" "numeric" "numeric" "numeric" "numeric"
Nov Dec Annual
"numeric" "numeric" "numeric" Poverty rate
# A tibble: 6 x 6
`NOTE: Number in thousa… ...2 ...3 ...4 ...5 ...6
<chr> <chr> <chr> <chr> <chr> <chr>
1 2018 <NA> <NA> <NA> <NA> <NA>
2 STATE Total Number "Standard\n… Percent "Standard\ner…
3 Alabama 4877 779 "65" 16 "1.3"
4 Alaska 720 94 "9" 13.1 "1.2"
5 Arizona 7241 929 "80" 12.80000000… "1.1000000000…
6 Arkansas 2912 462 "38" 15.9 "1.3" colnames(poverty_rate_data) <- c("STATE",
"Total",
"Number",
"Number_se",
"Percent",
"Percent_se")
tail(poverty_rate_data)# A tibble: 6 x 6
STATE Total Number Number_se Percent Percent_se
<chr> <chr> <chr> <chr> <chr> <chr>
1 Wisconsin 4724 403 57 8.5 1.1000000000…
2 Wyoming 468 49 20 10.4 4
3 Standard errors shown in this ta… <NA> <NA> <NA> <NA> <NA>
4 For information on confidentiali… <NA> <NA> <NA> <NA> <NA>
5 Footnotes are available at <www.… <NA> <NA> <NA> <NA> <NA>
6 SOURCE: U.S. Bureau of the Censu… <NA> <NA> <NA> <NA> <NA> notes <- 4
poverty_rate_data <- poverty_rate_data[-((dim(poverty_rate_data)[1]-notes+1):dim(poverty_rate_data)[1]),]
states_eq <- 51
extra_col <- 2
rep_rows <- states_eq + extra_col
groups <- (dim(poverty_rate_data)[1])/(rep_rows)
paste(groups - (2018-1980 + 1), "extra groups")[1] "2 extra groups"poverty_rate_data$year_group <- rep(1:groups, each=rep_rows)
poverty_rate_data <- poverty_rate_data %>%
group_by(year_group) %>%
group_split()
head(poverty_rate_data[[1]])# A tibble: 6 x 7
STATE Total Number Number_se Percent Percent_se year_group
<chr> <chr> <chr> <chr> <chr> <chr> <int>
1 2018 <NA> <NA> <NA> <NA> <NA> 1
2 STATE Total Number "Standard\ner… Percent "Standard\nerro… 1
3 Alabama 4877 779 "65" 16 "1.3" 1
4 Alaska 720 94 "9" 13.1 "1.2" 1
5 Arizona 7241 929 "80" 12.8000000000… "1.100000000000… 1
6 Arkans… 2912 462 "38" 15.9 "1.3" 1poverty_rate_data <- poverty_rate_data %>%
map(~mutate(.,
row_id = row_number())) %>%
map(~filter(.,row_id != 2)) %>%
map(~dplyr::select(.,-row_id))
poverty_rate_data_names <- poverty_rate_data %>%
sapply(., "[",1,1, drop=TRUE) %>%
str_replace_all(.,"[:space:]","_")
names(poverty_rate_data) <- poverty_rate_data_names
# Recall 2 extra groups.
# footnotes available at https://www.census.gov/topics/income-poverty/poverty/guidance/poverty-footnotes/cps-historic-footnotes.html
poverty_rate_data$`2017_(21)` <- NULL
poverty_rate_data$`2013_(19)` <- NULL
poverty_rate_data_names <- poverty_rate_data %>%
sapply(., "[",1,1, drop=TRUE) %>%
str_sub(., start = 1, end=4)
names(poverty_rate_data) <- poverty_rate_data_names
poverty_rate_data <- poverty_rate_data %>%
map_df(bind_rows, .id = "YEAR") %>%
dplyr::select(-year_group)
poverty_rate_data <- poverty_rate_data %>%
mutate(n_na = rowSums(is.na(.)))
# This shows that there is systematic missing values stemmingly *solely* from the rows without poverty data and only a label designating the year
poverty_rate_data %>%
group_by(n_na) %>%
tally()# A tibble: 2 x 2
n_na n
<dbl> <int>
1 0 1989
2 5 39 YEAR STATE Total Number Number_se Percent
"character" "character" "character" "character" "character" "character"
Percent_se n_na
"character" "numeric" poverty_rate_data <- poverty_rate_data %>%
drop_na() %>%
dplyr::select(-Number,
-Number_se,
-Percent_se,
-n_na,
-Total) %>%
rename("VALUE"=Percent) %>%
mutate(VARIABLE = "Poverty_rate",
YEAR = as.numeric(YEAR),
VALUE = as.numeric(VALUE))
colnames(poverty_rate_data)[1] "YEAR" "STATE" "VALUE" "VARIABLE"Violent crime
https://www.ucrdatatool.gov/Search/Crime/State/StatebyState.cfm
crime_data <- read_lines("docs/Crime/CrimeStatebyState.csv", skip = 2, skip_empty_rows = TRUE)
length(crime_data)[1] 2254crime_data <- crime_data[-(2143:length(crime_data))]
x <- 2014-1977+1
rep_cycle <- 2 + 2 + x
rep_cycle_cut <- 2 + x
delete_rows <- c(seq(2,length(crime_data),rep_cycle),
seq(3,length(crime_data),rep_cycle))
crime_data <- crime_data[-delete_rows]
crime_data <- data.frame(cbind(crime_data, rep(1:(length(crime_data)/rep_cycle_cut),each=rep_cycle_cut)))
colnames(crime_data) <- c("String","STATE_GROUP")
crime_data <- crime_data %>%
group_by(STATE_GROUP) %>%
group_split()
columns_crime_data <- 8
crime_data <- crime_data %>%
map(~mutate(.,
State = case_when(str_detect(String, "Estimated crime in ") ~ substring(String, nchar("Estimated crime in ")+1)),
row_id = row_number())) %>%
map(~fill(., State)) %>%
map(~filter(.,row_id > 2)) %>%
map(~mutate(.,
String = paste0(String, ",", State))) %>%
map(~dplyr::select(.,String)) %>%
map(~str_split_fixed(.$String,",",columns_crime_data + 1)) %>%
map(~data.frame(.)) %>%
map(~rename(.,"YEAR"=X1,
"Extra_col1"=X2,
"VC"=X3,
"Extra_col2"=X4,
"Extra_col3"=X5,
"Extra_col4"=X6,
"Extra_col5"=X7,
"Extra_col6"=X8,
"STATE"=X9)) %>%
map(~dplyr::select(.,-contains("Extra_col"))) %>%
map(~.x %>% mutate_all(~trimws(.,which = "both"))) %>%
map_df(bind_rows)
sapply(crime_data, class) YEAR VC STATE
"character" "character" "character" RTC laws
DAWpaper_p_62 <- DAWpaper[[62]]
p_62 <- DAWpaper_p_62 %>%
strsplit("\n") %>%
unlist() %>%
as.data.frame() %>%
slice(-(1:2))
apply(p_62, 1, nchar) [1] 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109
[20] 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109 109
[39] 109 109 109 109 109 109 109 109 109 109 109 109 109 109 63[1] " 60" [1] 3 4 4 4 3 4 2 3 2 4 4 3 4 3 4 4 4 4 4 4 3 2 4 4 4 4 4 4 4 2 3 3 3 3 3 4 4 4
[39] 3 3 2 3 3 4 4 4 3 4 2 3 4 4 [1] 2 3 3 3 2 3 2 2 2 3 3 2 3 2 3 3 3 3 3 3 2 2 3 3 3 3 3 3 3 2 2 3 2 3 3 3 3 3
[39] 3 3 2 3 3 3 3 3 2 3 2 3 3 3 [1] 2 2 2 2 1 2 1 1 1 2 2 2 2 1 2 2 2 2 2 2 1 1 2 2 2 2 2 2 2 1 1 2 2 2 2 2 2 2
[39] 2 2 1 2 2 2 2 2 2 2 1 2 2 2 [1] 1 0 0 0 1 0 1 1 1 0 0 1 0 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 1 1 0 1 0 0 0 0 0
[39] 0 0 1 0 0 0 0 0 1 0 1 0 0 0 .
1 Alabama 1975 1975
2 Alaska 10/1/1994 0.252 1995
3 Arizona 7/17/1994 0.460 1995
4 Arkansas 7/27/1995 0.433 1996
5 California N/A 0
6 Colorado 5/17/2003 0.627 2003
apply(p_62, 1, str_count, "\\\\s{40,}")
1 1
2 0
3 0
4 0
5 1
6 0p_62 <- p_62 %>%
apply(1,str_replace_all, "\\s{40,}", "|N/A|") %>%
str_replace_all("\\s{2,15}", "|") %>%
as.data.frame()
p_62 <- sapply(p_62$., str_split, "\\|{1,}")
sapply(p_62, nchar)$`|Alabama||1975|N/A|1975`
[1] 0 7 4 3 4
$`|Alaska||10/1/1994||0.252|||1995`
[1] 0 6 9 5 4
$`|Arizona| 7/17/1994||0.460|||1995`
[1] 0 7 10 5 4
$`|Arkansas| 7/27/1995||0.433|||1996`
[1] 0 8 10 5 4
$`|California||N/A|N/A|0`
[1] 0 10 3 3 1
$`|Colorado| 5/17/2003||0.627|||2003`
[1] 0 8 10 5 4
$`|Connecticut||1970|N/A|1970`
[1] 0 11 4 3 4
$`|Delaware||N/A|N/A|0`
[1] 0 8 3 3 1
$`District of Columbia|N/A|N/A|0`
[1] 20 3 3 1
$`|Florida| 10/1/1987||0.252|||1988`
[1] 0 7 10 5 4
$`|Georgia| 8/25/1989||0.353|||1990`
[1] 0 7 10 5 4
$`|Hawaii||N/A|N/A|0`
[1] 0 6 3 3 1
$`|Idaho||7/1/1990||0.504|||1990`
[1] 0 5 8 5 4
$`|Illinois| 1/5/2014|N/A|2014`
[1] 0 8 9 3 4
$`|Indiana| 1/15/1980||0.962|||1980`
[1] 0 7 10 5 4
$`|Iowa||1/1/2011||1.000|||2011`
[1] 0 4 8 5 4
$`|Kansas||1/1/2007||1.000|||2007`
[1] 0 6 8 5 4
$`|Kentucky| 10/1/1996||0.251|||1997`
[1] 0 8 10 5 4
$`|Louisiana|4/19/1996||0.702|||1996`
[1] 0 9 9 5 4
$`|Maine||9/19/1985||0.285|||1986`
[1] 0 5 9 5 4
$`|Maryland||N/A|N/A|0`
[1] 0 8 3 3 1
$`|Massachusetts||N/A|N/A|0`
[1] 0 13 3 3 1
$`|Michigan||7/1/2001||0.504|||2001`
[1] 0 8 8 5 4
$`|Minnesota| 5/28/2003||0.597|||2003`
[1] 0 9 10 5 4
$`|Mississippi|7/1/1990||0.504|||1990`
[1] 0 11 8 5 4
$`|Missouri| 2/26/2004||0.847|||2004`
[1] 0 8 10 5 4
$`|Montana||10/1/1991||0.252|||1992`
[1] 0 7 9 5 4
$`|Nebraska||1/1/2007||1.000|||2007`
[1] 0 8 8 5 4
$`|Nevada||10/1/1995||0.252|||1996`
[1] 0 6 9 5 4
$`|New Hampshire||1959|N/A|1959`
[1] 0 13 4 3 4
$`|New Jersey||N/A|N/A|0`
[1] 0 10 3 3 1
$`|New Mexico||1/1/2004||1.000|||2004`
[1] 0 10 8 5 4
$`|New York||N/A|N/A|0`
[1] 0 8 3 3 1
$`|North Carolina|12/1/1995||0.085|||1996`
[1] 0 14 9 5 4
$`|North Dakota| 8/1/1985||0.419|||1986`
[1] 0 12 9 5 4
$`|Ohio||4/8/2004||0.732|||2004`
[1] 0 4 8 5 4
$`|Oklahoma||1/1/1996||1.000|||1996`
[1] 0 8 8 5 4
$`|Oregon||1/1/1990||1.000|||1990`
[1] 0 6 8 5 4
$`|Pennsylvania|6/17/1989||0.542|||1989`
[1] 0 12 9 5 4
$`|Philadelphia|10/11/1995||0.225|||1996`
[1] 0 12 10 5 4
$`|Rhode Island||N/A|N/A|0`
[1] 0 12 3 3 1
$`|South Carolina|8/23/1996||0.358|||1997`
[1] 0 14 9 5 4
$`|South Dakota| 7/1/1985||0.504|||1985`
[1] 0 12 9 5 4
$`|Tennessee| 10/1/1996||0.251|||1997`
[1] 0 9 10 5 4
$`|Texas||1/1/1996||1.000|||1996`
[1] 0 5 8 5 4
$`|Utah||5/1/1995||0.671|||1995`
[1] 0 4 8 5 4
$`|Vermont||1970|N/A|1970`
[1] 0 7 4 3 4
$`|Virginia| 5/5/1995||0.660|||1995`
[1] 0 8 9 5 4
$`|Washington||1961|N/A|1961`
[1] 0 10 4 3 4
$`|West Virginia|7/7/1989||0.488|||1990`
[1] 0 13 8 5 4
$`|Wisconsin| 11/1/2011||0.167|||2012`
[1] 0 9 10 5 4
$`|Wyoming||10/1/1994||0.252|||1995`
[1] 0 7 9 5 4p_62 <- lapply(p_62, function(x) x[nchar(x) > 0])
p_62 <- as.data.frame(do.call(rbind, p_62))
rownames(p_62) [1] "|Alabama||1975|N/A|1975"
[2] "|Alaska||10/1/1994||0.252|||1995"
[3] "|Arizona| 7/17/1994||0.460|||1995"
[4] "|Arkansas| 7/27/1995||0.433|||1996"
[5] "|California||N/A|N/A|0"
[6] "|Colorado| 5/17/2003||0.627|||2003"
[7] "|Connecticut||1970|N/A|1970"
[8] "|Delaware||N/A|N/A|0"
[9] "District of Columbia|N/A|N/A|0"
[10] "|Florida| 10/1/1987||0.252|||1988"
[11] "|Georgia| 8/25/1989||0.353|||1990"
[12] "|Hawaii||N/A|N/A|0"
[13] "|Idaho||7/1/1990||0.504|||1990"
[14] "|Illinois| 1/5/2014|N/A|2014"
[15] "|Indiana| 1/15/1980||0.962|||1980"
[16] "|Iowa||1/1/2011||1.000|||2011"
[17] "|Kansas||1/1/2007||1.000|||2007"
[18] "|Kentucky| 10/1/1996||0.251|||1997"
[19] "|Louisiana|4/19/1996||0.702|||1996"
[20] "|Maine||9/19/1985||0.285|||1986"
[21] "|Maryland||N/A|N/A|0"
[22] "|Massachusetts||N/A|N/A|0"
[23] "|Michigan||7/1/2001||0.504|||2001"
[24] "|Minnesota| 5/28/2003||0.597|||2003"
[25] "|Mississippi|7/1/1990||0.504|||1990"
[26] "|Missouri| 2/26/2004||0.847|||2004"
[27] "|Montana||10/1/1991||0.252|||1992"
[28] "|Nebraska||1/1/2007||1.000|||2007"
[29] "|Nevada||10/1/1995||0.252|||1996"
[30] "|New Hampshire||1959|N/A|1959"
[31] "|New Jersey||N/A|N/A|0"
[32] "|New Mexico||1/1/2004||1.000|||2004"
[33] "|New York||N/A|N/A|0"
[34] "|North Carolina|12/1/1995||0.085|||1996"
[35] "|North Dakota| 8/1/1985||0.419|||1986"
[36] "|Ohio||4/8/2004||0.732|||2004"
[37] "|Oklahoma||1/1/1996||1.000|||1996"
[38] "|Oregon||1/1/1990||1.000|||1990"
[39] "|Pennsylvania|6/17/1989||0.542|||1989"
[40] "|Philadelphia|10/11/1995||0.225|||1996"
[41] "|Rhode Island||N/A|N/A|0"
[42] "|South Carolina|8/23/1996||0.358|||1997"
[43] "|South Dakota| 7/1/1985||0.504|||1985"
[44] "|Tennessee| 10/1/1996||0.251|||1997"
[45] "|Texas||1/1/1996||1.000|||1996"
[46] "|Utah||5/1/1995||0.671|||1995"
[47] "|Vermont||1970|N/A|1970"
[48] "|Virginia| 5/5/1995||0.660|||1995"
[49] "|Washington||1961|N/A|1961"
[50] "|West Virginia|7/7/1989||0.488|||1990"
[51] "|Wisconsin| 11/1/2011||0.167|||2012"
[52] "|Wyoming||10/1/1994||0.252|||1995" rownames(p_62) <- c()
colnames(p_62) <- c("STATE",
"E_Date_RTC",
"Frac_Yr_Eff_Yr_Pass",
"RTC_Date_SA")
sapply(p_62, class) STATE E_Date_RTC Frac_Yr_Eff_Yr_Pass RTC_Date_SA
"character" "character" "character" "character" p_62 <- p_62 %>%
dplyr::select(STATE, RTC_Date_SA) %>%
rename("RTC_LAW_YEAR"=RTC_Date_SA) %>%
mutate(RTC_LAW_YEAR = as.numeric(RTC_LAW_YEAR)) %>%
mutate(RTC_LAW_YEAR = case_when(RTC_LAW_YEAR == 0 ~ Inf,
TRUE ~ RTC_LAW_YEAR))
sapply(p_62, class) STATE RTC_LAW_YEAR
"character" "numeric" STATE RTC_LAW_YEAR
1 Alabama 1975
2 Alaska 1995
3 Arizona 1995
4 Arkansas 1996
5 California Inf
6 Colorado 2003Checkpoint
[1] "YEAR" "STATE" "VARIABLE" "VALUE" [1] "YEAR" "STATE" "VARIABLE" "VALUE" [1] "STATE" "YEAR" "VALUE" "VARIABLE"[1] "YEAR" "STATE" "VALUE" "VARIABLE"[1] "YEAR" "VALUE" "STATE" "VARIABLE"# A tibble: 6 x 4
YEAR STATE VARIABLE VALUE
<dbl> <chr> <chr> <dbl>
1 1990 Alabama Black_Male_15_to_19_years 1.23
2 1990 Alabama Black_Male_20_to_39_years 3.62
3 1990 Alabama Other_Male_15_to_19_years 0.0470
4 1990 Alabama Other_Male_20_to_39_years 0.176
5 1990 Alabama White_Male_15_to_19_years 2.70
6 1990 Alabama White_Male_20_to_39_years 11.6 # A tibble: 6 x 4
YEAR STATE VARIABLE VALUE
<dbl> <chr> <chr> <dbl>
1 1990 Alabama Black_Female_10_to_19_years 2.45
2 1990 Alabama Black_Female_20_to_29_years 2.20
3 1990 Alabama Black_Female_30_to_39_years 2.18
4 1990 Alabama Black_Female_40_to_49_years 1.37
5 1990 Alabama Black_Female_50_to_64_years 1.53
6 1990 Alabama Black_Female_65_years_and_over 1.67# A tibble: 6 x 4
STATE YEAR VALUE VARIABLE
<chr> <dbl> <dbl> <chr>
1 Alabama 1977 7.3 Unemployment_rate
2 Alabama 1978 6.4 Unemployment_rate
3 Alabama 1979 7.2 Unemployment_rate
4 Alabama 1980 8.9 Unemployment_rate
5 Alabama 1981 10.6 Unemployment_rate
6 Alabama 1982 14.1 Unemployment_rate# A tibble: 6 x 4
YEAR STATE VALUE VARIABLE
<dbl> <chr> <dbl> <chr>
1 2018 Alabama 16 Poverty_rate
2 2018 Alaska 13.1 Poverty_rate
3 2018 Arizona 12.8 Poverty_rate
4 2018 Arkansas 15.9 Poverty_rate
5 2018 California 11.9 Poverty_rate
6 2018 Colorado 9.1 Poverty_rate# A tibble: 6 x 4
YEAR VALUE STATE VARIABLE
<dbl> <dbl> <chr> <chr>
1 1977 15293 Alabama Viol_crime_count
2 1978 15682 Alabama Viol_crime_count
3 1979 15578 Alabama Viol_crime_count
4 1980 17320 Alabama Viol_crime_count
5 1981 18423 Alabama Viol_crime_count
6 1982 17653 Alabama Viol_crime_countJoin
Donohue, et al.
DONOHUE_DF <- bind_rows(dem_DONOHUE,
ue_rate_data,
poverty_rate_data,
crime_data,
population_data,
ps_data) %>%
pivot_wider(names_from = "VARIABLE",
values_from = "VALUE") %>%
left_join(p_62 , by = c("STATE")) %>%
mutate(RTC_LAW = case_when(YEAR >= RTC_LAW_YEAR ~ TRUE,
TRUE ~ FALSE))
DONOHUE_DF %>%
group_by(YEAR) %>%
tally() %>%
filter(n != 51) %>%
print(n=dim(.)[1])# A tibble: 33 x 2
YEAR n
<dbl> <int>
1 1980 52
2 1981 52
3 1982 52
4 1983 52
5 1984 52
6 1985 52
7 1986 52
8 1987 52
9 1988 52
10 1989 52
11 1990 52
12 1991 52
13 1992 52
14 1993 52
15 1994 52
16 1995 52
17 1996 52
18 1997 52
19 1998 52
20 1999 52
21 2000 52
22 2001 52
23 2002 52
24 2003 52
25 2004 52
26 2005 52
27 2006 52
28 2007 52
29 2008 52
30 2009 52
31 2010 52
32 2011 52
33 2012 52 Alabama Alaska Arizona
44 44 44
Arkansas California Colorado
44 44 44
Connecticut D.C. Delaware
44 33 44
District of Columbia Florida Georgia
44 44 44
Hawaii Idaho Illinois
44 44 44
Indiana Iowa Kansas
44 44 44
Kentucky Louisiana Maine
44 44 44
Maryland Massachusetts Michigan
44 44 44
Minnesota Mississippi Missouri
44 44 44
Montana Nebraska Nevada
44 44 44
New Hampshire New Jersey New Mexico
44 44 44
New York North Carolina North Dakota
44 44 44
Ohio Oklahoma Oregon
44 44 44
Pennsylvania Rhode Island South Carolina
44 44 44
South Dakota Tennessee Texas
44 44 44
Utah Vermont Virginia
44 44 44
Washington West Virginia Wisconsin
44 44 44
Wyoming
44 [1] 44DONOHUE_DF <- DONOHUE_DF %>%
mutate(STATE = fct_collapse(STATE, "District of Columbia"=c("District of Columbia","D.C.")))
summary(as.factor(DONOHUE_DF$STATE)) Alabama Alaska Arizona
44 44 44
Arkansas California Colorado
44 44 44
Connecticut District of Columbia Delaware
44 77 44
Florida Georgia Hawaii
44 44 44
Idaho Illinois Indiana
44 44 44
Iowa Kansas Kentucky
44 44 44
Louisiana Maine Maryland
44 44 44
Massachusetts Michigan Minnesota
44 44 44
Mississippi Missouri Montana
44 44 44
Nebraska Nevada New Hampshire
44 44 44
New Jersey New Mexico New York
44 44 44
North Carolina North Dakota Ohio
44 44 44
Oklahoma Oregon Pennsylvania
44 44 44
Rhode Island South Carolina South Dakota
44 44 44
Tennessee Texas Utah
44 44 44
Vermont Virginia Washington
44 44 44
West Virginia Wisconsin Wyoming
44 44 44 [1] 51DONOHUE_DF <- DONOHUE_DF %>%
group_by(STATE, YEAR) %>%
summarise_all(~na.omit(unique(.))) %>%
ungroup() # This identifies unique observations, coalesces rows according to the grouping variable(s), and gets rid of of units that have incomplete data. This gives returns a dataframe with the most complete information.
summary(as.factor(DONOHUE_DF$STATE)) Alabama Alaska Arizona
21 21 21
Arkansas California Colorado
21 21 21
Connecticut District of Columbia Delaware
21 21 21
Florida Georgia Hawaii
21 21 21
Idaho Illinois Indiana
21 21 21
Iowa Kansas Kentucky
21 21 21
Louisiana Maine Maryland
21 21 21
Massachusetts Michigan Minnesota
21 21 21
Mississippi Missouri Montana
21 21 21
Nebraska Nevada New Hampshire
21 21 21
New Jersey New Mexico New York
21 21 21
North Carolina North Dakota Ohio
21 21 21
Oklahoma Oregon Pennsylvania
21 21 21
Rhode Island South Carolina South Dakota
21 21 21
Tennessee Texas Utah
21 21 21
Vermont Virginia Washington
21 21 21
West Virginia Wisconsin Wyoming
21 21 21 baseline_year <- min(DONOHUE_DF$YEAR)
censoring_year <- max(DONOHUE_DF$YEAR)
# Need to fix this to ensure severe bias is not introduced by prevalent "cases"
DONOHUE_DF <- DONOHUE_DF %>%
mutate(TIME_0 = baseline_year,
TIME_INF = censoring_year) %>%
filter(RTC_LAW_YEAR > TIME_0)
DONOHUE_DF <- DONOHUE_DF %>%
mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
Population_log = log(Population))
summary(droplevels(as.factor(DONOHUE_DF$STATE))) Alaska Arizona Arkansas
21 21 21
California Colorado District of Columbia
21 21 21
Delaware Hawaii Illinois
21 21 21
Iowa Kansas Kentucky
21 21 21
Louisiana Maryland Massachusetts
21 21 21
Michigan Minnesota Missouri
21 21 21
Montana Nebraska Nevada
21 21 21
New Jersey New Mexico New York
21 21 21
North Carolina Ohio Oklahoma
21 21 21
Rhode Island South Carolina Tennessee
21 21 21
Texas Utah Virginia
21 21 21
Wisconsin Wyoming
21 21 [1] 35Lott and Mustard
LOTT_DF <- bind_rows(dem_LOTT,
ue_rate_data,
poverty_rate_data,
crime_data,
population_data,
ps_data) %>%
pivot_wider(names_from = "VARIABLE",
values_from = "VALUE") %>%
left_join(p_62 , by = c("STATE")) %>%
mutate(RTC_LAW = case_when(YEAR >= RTC_LAW_YEAR ~ TRUE,
TRUE ~ FALSE))
LOTT_DF %>%
group_by(YEAR) %>%
tally() %>%
filter(n != 51) %>%
print(n=dim(.)[1])# A tibble: 33 x 2
YEAR n
<dbl> <int>
1 1980 52
2 1981 52
3 1982 52
4 1983 52
5 1984 52
6 1985 52
7 1986 52
8 1987 52
9 1988 52
10 1989 52
11 1990 52
12 1991 52
13 1992 52
14 1993 52
15 1994 52
16 1995 52
17 1996 52
18 1997 52
19 1998 52
20 1999 52
21 2000 52
22 2001 52
23 2002 52
24 2003 52
25 2004 52
26 2005 52
27 2006 52
28 2007 52
29 2008 52
30 2009 52
31 2010 52
32 2011 52
33 2012 52 Alabama Alaska Arizona
44 44 44
Arkansas California Colorado
44 44 44
Connecticut D.C. Delaware
44 33 44
District of Columbia Florida Georgia
44 44 44
Hawaii Idaho Illinois
44 44 44
Indiana Iowa Kansas
44 44 44
Kentucky Louisiana Maine
44 44 44
Maryland Massachusetts Michigan
44 44 44
Minnesota Mississippi Missouri
44 44 44
Montana Nebraska Nevada
44 44 44
New Hampshire New Jersey New Mexico
44 44 44
New York North Carolina North Dakota
44 44 44
Ohio Oklahoma Oregon
44 44 44
Pennsylvania Rhode Island South Carolina
44 44 44
South Dakota Tennessee Texas
44 44 44
Utah Vermont Virginia
44 44 44
Washington West Virginia Wisconsin
44 44 44
Wyoming
44 [1] 44LOTT_DF <- LOTT_DF %>%
mutate(STATE = fct_collapse(STATE, "District of Columbia"=c("District of Columbia","D.C.")))
summary(as.factor(LOTT_DF$STATE)) Alabama Alaska Arizona
44 44 44
Arkansas California Colorado
44 44 44
Connecticut District of Columbia Delaware
44 77 44
Florida Georgia Hawaii
44 44 44
Idaho Illinois Indiana
44 44 44
Iowa Kansas Kentucky
44 44 44
Louisiana Maine Maryland
44 44 44
Massachusetts Michigan Minnesota
44 44 44
Mississippi Missouri Montana
44 44 44
Nebraska Nevada New Hampshire
44 44 44
New Jersey New Mexico New York
44 44 44
North Carolina North Dakota Ohio
44 44 44
Oklahoma Oregon Pennsylvania
44 44 44
Rhode Island South Carolina South Dakota
44 44 44
Tennessee Texas Utah
44 44 44
Vermont Virginia Washington
44 44 44
West Virginia Wisconsin Wyoming
44 44 44 [1] 51LOTT_DF <- LOTT_DF %>%
group_by(STATE, YEAR) %>%
summarise_all(~na.omit(unique(.))) %>%
ungroup() # This identifies unique observations, coalesces rows according to the grouping variable(s), and gets rid of of units that have incomplete data. This gives returns a dataframe with the most complete information.
summary(as.factor(LOTT_DF$STATE)) Alabama Alaska Arizona
21 21 21
Arkansas California Colorado
21 21 21
Connecticut District of Columbia Delaware
21 21 21
Florida Georgia Hawaii
21 21 21
Idaho Illinois Indiana
21 21 21
Iowa Kansas Kentucky
21 21 21
Louisiana Maine Maryland
21 21 21
Massachusetts Michigan Minnesota
21 21 21
Mississippi Missouri Montana
21 21 21
Nebraska Nevada New Hampshire
21 21 21
New Jersey New Mexico New York
21 21 21
North Carolina North Dakota Ohio
21 21 21
Oklahoma Oregon Pennsylvania
21 21 21
Rhode Island South Carolina South Dakota
21 21 21
Tennessee Texas Utah
21 21 21
Vermont Virginia Washington
21 21 21
West Virginia Wisconsin Wyoming
21 21 21 baseline_year <- min(LOTT_DF$YEAR)
censoring_year <- max(LOTT_DF$YEAR)
# Need to fix this to ensure severe bias is not introduced by prevalent "cases"
LOTT_DF <- LOTT_DF %>%
mutate(TIME_0 = baseline_year,
TIME_INF = censoring_year) %>%
filter(RTC_LAW_YEAR > TIME_0)
LOTT_DF <- LOTT_DF %>%
mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
Population_log = log(Population))
summary(droplevels(as.factor(LOTT_DF$STATE))) Alaska Arizona Arkansas
21 21 21
California Colorado District of Columbia
21 21 21
Delaware Hawaii Illinois
21 21 21
Iowa Kansas Kentucky
21 21 21
Louisiana Maryland Massachusetts
21 21 21
Michigan Minnesota Missouri
21 21 21
Montana Nebraska Nevada
21 21 21
New Jersey New Mexico New York
21 21 21
North Carolina Ohio Oklahoma
21 21 21
Rhode Island South Carolina Tennessee
21 21 21
Texas Utah Virginia
21 21 21
Wisconsin Wyoming
21 21 [1] 35Data Exploration
STATE YEAR Black_Male_15_to_19_years
"factor" "numeric" "numeric"
Black_Male_20_to_39_years Other_Male_15_to_19_years Other_Male_20_to_39_years
"numeric" "numeric" "numeric"
White_Male_15_to_19_years White_Male_20_to_39_years Unemployment_rate
"numeric" "numeric" "numeric"
Poverty_rate Viol_crime_count Population
"numeric" "numeric" "numeric"
police_per_100k_lag RTC_LAW_YEAR RTC_LAW
"numeric" "numeric" "logical"
TIME_0 TIME_INF Viol_crime_rate_1k
"numeric" "numeric" "numeric"
Viol_crime_rate_1k_log Population_log
"numeric" "numeric" DONOHUE_DF %>%
mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
ggplot(aes(x = YEAR, y = Viol_crime_rate_100k_log, color = STATE)) +
geom_point(size = 0.5) +
geom_line(aes(group=STATE),
size = 0.5,
show.legend = FALSE) +
geom_text_repel(data = DONOHUE_DF %>%
mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
filter(YEAR == last(YEAR)),
aes(label = STATE,
x = YEAR,
y = Viol_crime_rate_100k_log),
size = 3,
alpha = 1,
nudge_x = 10,
direction = "y",
hjust = 1,
vjust = 1,
segment.size = 0.25,
segment.alpha = 0.25,
force = 1,
max.iter = 9999) +
guides(color = FALSE) +
scale_x_continuous(breaks = seq(1980, 2015, by = 1),
limits = c(1980, 2015),
labels = c(seq(1980, 2010, by = 1), rep("", 5))) +
scale_y_continuous(breaks = seq(3.5, 8.5, by = 0.5),
limits = c(3.5, 8.5)) +
labs(title = "States have different levels of crime",
x = "Year",
y = "ln(violent crimes per 100,000 people)") +
theme_minimal() +
theme(axis.text.x = element_text(angle = 90))
DONOHUE_DF %>%
group_by(YEAR) %>%
summarise(Viol_crime_count = sum(Viol_crime_count),
Population = sum(Population),
.groups = "drop") %>%
mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
ggplot(aes(x = YEAR, y = Viol_crime_rate_100k_log)) +
geom_line() +
scale_x_continuous(breaks = seq(1980, 2010, by = 1),
limits = c(1980, 2010),
labels = c(seq(1980, 2010, by = 1))) +
scale_y_continuous(breaks = seq(5.75, 6.75, by = 0.25),
limits = c(5.75, 6.75)) +
labs(title = "Crime rates fluctuate over time",
x = "Year",
y = "ln(violent crimes per 100,000 people)") +
theme_minimal() +
theme(axis.text.x = element_text(angle = 90))
Data Analysis
Donohue, et al.
Some code taken from http://karthur.org/2019/implementing-fixed-effects-panel-models-in-r.html
d_panel_DONOHUE <- pdata.frame(DONOHUE_DF, index=c("STATE", "YEAR"))
DONOHUE_OUTPUT <- plm(Viol_crime_rate_1k_log ~
RTC_LAW +
White_Male_15_to_19_years +
White_Male_20_to_39_years +
Black_Male_15_to_19_years +
Black_Male_20_to_39_years +
Other_Male_15_to_19_years +
Other_Male_20_to_39_years +
Unemployment_rate +
Poverty_rate +
Population_log +
police_per_100k_lag,
effect = "twoways",
model = "within",
data=d_panel_DONOHUE)
summary(DONOHUE_OUTPUT)Twoways effects Within Model
Call:
plm(formula = Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years +
White_Male_20_to_39_years + Black_Male_15_to_19_years + Black_Male_20_to_39_years +
Other_Male_15_to_19_years + Other_Male_20_to_39_years + Unemployment_rate +
Poverty_rate + Population_log + police_per_100k_lag, data = d_panel_DONOHUE,
effect = "twoways", model = "within")
Balanced Panel: n = 35, T = 21, N = 735
Residuals:
Min. 1st Qu. Median 3rd Qu. Max.
-0.6338573 -0.0622728 -0.0032734 0.0600340 0.4747461
Coefficients:
Estimate Std. Error t-value Pr(>|t|)
RTC_LAWTRUE 0.01399747 0.01807103 0.7746 0.4388610
White_Male_15_to_19_years -0.07163612 0.04256304 -1.6831 0.0928302 .
White_Male_20_to_39_years 0.04735001 0.01368064 3.4611 0.0005722 ***
Black_Male_15_to_19_years 0.14345532 0.08877101 1.6160 0.1065624
Black_Male_20_to_39_years 0.13841529 0.02430620 5.6946 1.852e-08 ***
Other_Male_15_to_19_years 0.85500263 0.11590669 7.3766 4.822e-13 ***
Other_Male_20_to_39_years -0.25713549 0.04257069 -6.0402 2.554e-09 ***
Unemployment_rate 0.00221657 0.00654484 0.3387 0.7349615
Poverty_rate 0.00392491 0.00332665 1.1798 0.2384832
Population_log 0.23504152 0.09612692 2.4451 0.0147374 *
police_per_100k_lag 0.00054079 0.00017321 3.1222 0.0018723 **
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Total Sum of Squares: 12.935
Residual Sum of Squares: 10.268
R-Squared: 0.20621
Adj. R-Squared: 0.12909
F-statistic: 15.7996 on 11 and 669 DF, p-value: < 2.22e-16Lott and Mustard
Some code taken from http://karthur.org/2019/implementing-fixed-effects-panel-models-in-r.html
LOTT_variables <- LOTT_DF %>%
dplyr::select(RTC_LAW,
contains(c("White","Black","Other")),
Unemployment_rate,
Poverty_rate,
Population_log,
police_per_100k_lag) %>%
colnames()
LOTT_fmla <- as.formula(paste("Viol_crime_rate_1k_log ~",
paste(LOTT_variables, collapse = " + ")
)
)
d_panel_LOTT <- pdata.frame(LOTT_DF, index=c("STATE", "YEAR"))
LOTT_OUTPUT <- plm(LOTT_fmla,
model = "within",
effect = "twoways",
data=d_panel_LOTT)
summary(LOTT_OUTPUT)Twoways effects Within Model
Call:
plm(formula = LOTT_fmla, data = d_panel_LOTT, effect = "twoways",
model = "within")
Balanced Panel: n = 35, T = 21, N = 735
Residuals:
Min. 1st Qu. Median 3rd Qu. Max.
-0.46717726 -0.05325358 0.00074259 0.05557220 0.31537243
Coefficients:
Estimate Std. Error t-value Pr(>|t|)
RTC_LAWTRUE -0.02936965 0.01823854 -1.6103 0.1078246
White_Female_10_to_19_years 0.65921612 0.20489684 3.2173 0.0013594 **
White_Female_20_to_29_years 0.08644467 0.07612062 1.1356 0.2565382
White_Female_30_to_39_years -0.13836498 0.10773830 -1.2843 0.1995132
White_Female_40_to_49_years 0.47203824 0.10700674 4.4113 1.206e-05 ***
White_Female_50_to_64_years -0.43678487 0.09390272 -4.6515 4.007e-06 ***
White_Female_65_years_and_over -0.28217891 0.08930520 -3.1597 0.0016538 **
White_Male_10_to_19_years -0.58796604 0.19526018 -3.0112 0.0027049 **
White_Male_20_to_29_years 0.02921390 0.07057479 0.4139 0.6790551
White_Male_30_to_39_years 0.07899878 0.10478693 0.7539 0.4511875
White_Male_40_to_49_years -0.44302519 0.09301896 -4.7627 2.365e-06 ***
White_Male_50_to_64_years 0.35259054 0.09757265 3.6136 0.0003257 ***
White_Male_65_years_and_over 0.46833455 0.13366773 3.5037 0.0004908 ***
Black_Female_10_to_19_years -0.46902450 0.43012668 -1.0904 0.2759333
Black_Female_20_to_29_years -0.85330286 0.19903094 -4.2873 2.088e-05 ***
Black_Female_30_to_39_years 0.67000107 0.29117489 2.3010 0.0217112 *
Black_Female_40_to_49_years 0.20211428 0.24593810 0.8218 0.4114918
Black_Female_50_to_64_years 0.27010596 0.24815423 1.0885 0.2768024
Black_Female_65_years_and_over -0.12661080 0.36916618 -0.3430 0.7317382
Black_Male_10_to_19_years 0.74235062 0.44292888 1.6760 0.0942266 .
Black_Male_20_to_29_years 0.79460625 0.21556244 3.6862 0.0002470 ***
Black_Male_30_to_39_years -0.29673477 0.30748553 -0.9650 0.3348916
Black_Male_40_to_49_years -0.14562558 0.30662465 -0.4749 0.6349984
Black_Male_50_to_64_years -0.14915192 0.27623210 -0.5400 0.5894186
Black_Male_65_years_and_over -0.96725742 0.58296284 -1.6592 0.0975643 .
Other_Female_10_to_19_years -2.24967607 0.57904598 -3.8851 0.0001129 ***
Other_Female_20_to_29_years -0.27537653 0.30109748 -0.9146 0.3607592
Other_Female_30_to_39_years -2.45674942 0.40420766 -6.0779 2.093e-09 ***
Other_Female_40_to_49_years 1.44842440 0.52993251 2.7332 0.0064453 **
Other_Female_50_to_64_years 1.61920629 0.40211618 4.0267 6.336e-05 ***
Other_Female_65_years_and_over 1.40148342 0.29971128 4.6761 3.569e-06 ***
Other_Male_10_to_19_years 2.48313426 0.54927918 4.5207 7.345e-06 ***
Other_Male_20_to_29_years 0.25699446 0.29912664 0.8591 0.3905803
Other_Male_30_to_39_years 2.49248478 0.43813341 5.6889 1.948e-08 ***
Other_Male_40_to_49_years -1.53468291 0.51566283 -2.9761 0.0030294 **
Other_Male_50_to_64_years -2.01173714 0.48027699 -4.1887 3.200e-05 ***
Other_Male_65_years_and_over -2.05964386 0.42138889 -4.8878 1.291e-06 ***
Unemployment_rate -0.00605069 0.00626903 -0.9652 0.3348243
Poverty_rate 0.00210437 0.00285683 0.7366 0.4616286
Population_log 0.40657802 0.14084185 2.8868 0.0040237 **
police_per_100k_lag 0.00021813 0.00016227 1.3443 0.1793315
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Total Sum of Squares: 12.935
Residual Sum of Squares: 6.4494
R-Squared: 0.5014
Adj. R-Squared: 0.42727
F-statistic: 15.6726 on 41 and 639 DF, p-value: < 2.22e-16Comparing analyses
comparing_analyses <- DONOHUE_OUTPUT_TIDY %>%
bind_rows(LOTT_OUTPUT_TIDY) %>%
filter(term == "RTC_LAWTRUE")
library(grid)
comparing_analyses_plot <- ggplot(comparing_analyses) +
geom_point(aes(x = Analysis, y = estimate)) +
geom_errorbar(aes(x = Analysis, ymin = conf.low, ymax = conf.high), width = 0.25) +
geom_hline(yintercept = 0, color = "red") +
scale_y_continuous(breaks = seq(-0.2, 0.2, by = 0.05),
labels = seq(-0.2, 0.2, by = 0.05),
limits = c(-0.2,0.2)) +
geom_segment(aes(x = 1, y = 0.125, xend = 1, yend = 0.175),
arrow = arrow(angle = 45, ends = "last", type = "open"),
size = 2,
color = "green",
lineend = "butt",
linejoin = "mitre") +
geom_segment(aes(x = 2, y = -0.125, xend = 2, yend = -0.175),
arrow = arrow(angle = 45, ends = "last", type = "open"),
size = 2,
color = "red",
lineend = "butt",
linejoin = "mitre") +
theme_minimal() +
theme(axis.title.x = element_blank(),
axis.text = element_text(size = 12)) +
labs(title = "Effect estimate on ln(violent crimes per 100,000 people)",
y = "Effect estimate (95% CI)")
comparing_analyses_plot
Multicollinearity analysis
How did the above happen?
The analysis dataframes are very similar yet rendered very different results.
- different number of columns: 20 vs 50[1] TRUEThe only difference between the two dataframes rests in how the demographic variables were parameterized.
[1] "Black_Male_15_to_19_years" "Black_Male_20_to_39_years"
[3] "Other_Male_15_to_19_years" "Other_Male_20_to_39_years"
[5] "White_Male_15_to_19_years" "White_Male_20_to_39_years" [1] "Black_Female_10_to_19_years" "Black_Female_20_to_29_years"
[3] "Black_Female_30_to_39_years" "Black_Female_40_to_49_years"
[5] "Black_Female_50_to_64_years" "Black_Female_65_years_and_over"
[7] "Black_Male_10_to_19_years" "Black_Male_20_to_29_years"
[9] "Black_Male_30_to_39_years" "Black_Male_40_to_49_years"
[11] "Black_Male_50_to_64_years" "Black_Male_65_years_and_over"
[13] "Other_Female_10_to_19_years" "Other_Female_20_to_29_years"
[15] "Other_Female_30_to_39_years" "Other_Female_40_to_49_years"
[17] "Other_Female_50_to_64_years" "Other_Female_65_years_and_over"
[19] "Other_Male_10_to_19_years" "Other_Male_20_to_29_years"
[21] "Other_Male_30_to_39_years" "Other_Male_40_to_49_years"
[23] "Other_Male_50_to_64_years" "Other_Male_65_years_and_over"
[25] "White_Female_10_to_19_years" "White_Female_20_to_29_years"
[27] "White_Female_30_to_39_years" "White_Female_40_to_49_years"
[29] "White_Female_50_to_64_years" "White_Female_65_years_and_over"
[31] "White_Male_10_to_19_years" "White_Male_20_to_29_years"
[33] "White_Male_30_to_39_years" "White_Male_40_to_49_years"
[35] "White_Male_50_to_64_years" "White_Male_65_years_and_over" Clearly, this had an effect on the results of the analysis.
Let’s explore how this occured.
When seemingly independent variables are highly related to one another, the relationships estimated in an analysis may be distorted.
In regression analysis, this distortion is often a byproduct of a violation of the independence assumption. This distortion, if large enough, can impact statistical inference.
There are several ways we can diagnose multicollinearity.
Correlation
Again, multicollinearity often occurs when independent variables are highly related to one another. Consequently, we can evaluate these relationships be examining the correlation between variable pairs.
It is important to note that multicollinearity and correlation are not one and the same. Correlation can be thought of as the strength of the relationship between variables. On the other hand, multicollinearity can be thought of the the violation of the independence assumption that is a consequence of this correlation in a regression analysis.
Scatterplots
[1] "STATE" "YEAR"
[3] "Black_Male_15_to_19_years" "Black_Male_20_to_39_years"
[5] "Other_Male_15_to_19_years" "Other_Male_20_to_39_years"
[7] "White_Male_15_to_19_years" "White_Male_20_to_39_years"
[9] "Unemployment_rate" "Poverty_rate"
[11] "Viol_crime_count" "Population"
[13] "police_per_100k_lag" "RTC_LAW_YEAR"
[15] "RTC_LAW" "TIME_0"
[17] "TIME_INF" "Viol_crime_rate_1k"
[19] "Viol_crime_rate_1k_log" "Population_log" DONOHUE_DF %>%
dplyr::select(RTC_LAW,
Viol_crime_rate_1k_log,
Unemployment_rate,
Poverty_rate,
Population_log) %>%
ggpairs(.,
columns = c(2:5),
lower = list(continuous = wrap("smooth_loess",
color = "red",
alpha = 0.5,
size = 0.1)))
LOTT_DF %>%
dplyr::select(RTC_LAW,
Viol_crime_rate_1k_log,
Unemployment_rate,
Poverty_rate,
Population_log) %>%
ggpairs(.,
columns = c(2:5),
lower = list(continuous = wrap("smooth_loess",
color = "red",
alpha = 0.5,
size = 0.1)))
Heatmaps
cor_DONOHUE_dem <- cor(DONOHUE_DF %>% dplyr::select(contains("_years")))
corr_mat_DONOHUE <- ggcorrplot(cor_DONOHUE_dem,
tl.cex = 6,
hc.order = TRUE,
colors = c("red",
"white",
"red"),
outline.color = "transparent",
title = "Correlation Matrix, Analysis 1",
legend.title = TeX("$\\rho$"))
corr_mat_DONOHUE
cor_LOTT_dem <- cor(LOTT_DF %>% dplyr::select(contains("_years")))
corr_mat_LOTT <- ggcorrplot(cor_LOTT_dem,
tl.cex = 6,
hc.order = TRUE,
colors = c("red",
"white",
"red"),
outline.color = "transparent",
title = "Correlation Matrix, Analysis 2",
legend.title = TeX("$\\rho$"))
corr_mat_LOTT
Coefficient estimate instability
sims <- 250
# DONOHUE
# round(dim(DONOHUE_DF)[1]/2)
samps_DONOHUE <- lapply(rep(dim(DONOHUE_DF)[1]-1, sims),
function(x)DONOHUE_DF[sample(nrow(DONOHUE_DF),
size = x, replace = FALSE),])
fit_nls_on_bootstrap_DONOHUE <- function(split){
plm(Viol_crime_rate_1k_log ~
RTC_LAW +
White_Male_15_to_19_years +
White_Male_20_to_39_years +
Black_Male_15_to_19_years +
Black_Male_20_to_39_years +
Other_Male_15_to_19_years +
Other_Male_20_to_39_years +
Unemployment_rate +
Poverty_rate +
Population_log +
police_per_100k_lag,
data = data.frame(split),
index = c("STATE","YEAR"),
model = "within",
effect = "twoways")
}
samps_models_DONOHUE <- lapply(samps_DONOHUE, fit_nls_on_bootstrap_DONOHUE)
samps_models_DONOHUE <- samps_models_DONOHUE %>%
map(tidy)
names(samps_models_DONOHUE) <- paste0("DONOHUE_",1:length(samps_models_DONOHUE))
simulations_DONOHUE <- samps_models_DONOHUE %>%
bind_rows(.id = "ID") %>%
mutate(Analysis = "Analysis 1")
## LOTT
samps_LOTT <- lapply(rep(round(dim(LOTT_DF)[1]/2), sims),
function(x) LOTT_DF[sample(nrow(LOTT_DF),
size = x, replace = FALSE),])
fit_nls_on_bootstrap_LOTT <- function(split){
plm(LOTT_fmla,
data = data.frame(split),
index = c("STATE","YEAR"),
model = "within",
effect = "twoways")
}
samps_models_LOTT <- lapply(samps_LOTT, fit_nls_on_bootstrap_LOTT)
samps_models_LOTT <- samps_models_LOTT %>%
map(tidy)
names(samps_models_LOTT) <- paste0("LOTT_",1:length(samps_models_LOTT))
simulations_LOTT <- samps_models_LOTT %>%
bind_rows(.id = "Analysis") %>%
mutate(Analysis = "Analysis 2")
simulations <- bind_rows(simulations_DONOHUE,
simulations_LOTT)
simulation_plot <- simulations %>%
filter(term=="RTC_LAWTRUE") %>%
ggplot(aes(x = Analysis, y = estimate)) +
geom_jitter(alpha = 0.25,
width = 0.1) +
labs(title = "Coefficient instability",
subtitle = "Estimates sensitive to observation deletions",
x = "Term",
y = "Coefficient",
caption = "Results from simulations") +
theme_minimal() +
theme(axis.title.x = element_blank())
simulation_plot
VIF
design.matrix <- as.data.frame(model.matrix(DONOHUE_OUTPUT))
design.matrix$Viol_crime_rate_1k_log <- plm::Within(
d_panel_DONOHUE$Viol_crime_rate_1k_log)
lm_DONOHUE <- lm(Viol_crime_rate_1k_log ~
RTC_LAWTRUE + # logical class changes variable name after inital model
White_Male_15_to_19_years +
White_Male_20_to_39_years +
Black_Male_15_to_19_years +
Black_Male_20_to_39_years +
Other_Male_15_to_19_years +
Other_Male_20_to_39_years +
Unemployment_rate +
Poverty_rate +
Population_log +
police_per_100k_lag,
data = design.matrix)
vif(lm_DONOHUE) RTC_LAWTRUE White_Male_15_to_19_years White_Male_20_to_39_years
1.157336 1.753266 2.608183
Black_Male_15_to_19_years Black_Male_20_to_39_years Other_Male_15_to_19_years
1.332589 2.283867 1.681014
Other_Male_20_to_39_years Unemployment_rate Poverty_rate
1.407883 1.311134 1.198027
Population_log police_per_100k_lag
1.176024 1.117583 vif_DONOHUE <- vif(lm_DONOHUE)
vif_DONOHUE <- vif_DONOHUE %>%
as_tibble() %>%
cbind(., names(vif_DONOHUE)) %>%
as_tibble()
colnames(vif_DONOHUE) <- c("VIF", "Variable")
max_vif_DONOHUE <- max(vif(lm_DONOHUE)) design.matrix <- as.data.frame(model.matrix(LOTT_OUTPUT))
design.matrix$Viol_crime_rate_1k_log <- plm::Within(
d_panel_LOTT$Viol_crime_rate_1k_log)
LOTT_variables_ols <- LOTT_DF %>%
dplyr::select(RTC_LAW,
contains(c("White","Black","Other")),
Unemployment_rate,
Poverty_rate,
Population_log,
police_per_100k_lag) %>%
colnames() %>%
str_replace("RTC_LAW", "RTC_LAWTRUE") # logical class changes variable name after inital model
LOTT_fmla_ols <- as.formula(paste("Viol_crime_rate_1k_log ~",
paste(LOTT_variables_ols, collapse = " + ")
)
)
lm_LOTT <- lm(LOTT_fmla_ols,
data = design.matrix)
vif(lm_LOTT) RTC_LAWTRUE White_Female_10_to_19_years
1.792652 175.910307
White_Female_20_to_29_years White_Female_30_to_39_years
38.695213 79.741526
White_Female_40_to_49_years White_Female_50_to_64_years
29.102734 41.365488
White_Female_65_years_and_over White_Male_10_to_19_years
22.912619 180.294231
White_Male_20_to_29_years White_Male_30_to_39_years
37.977938 92.987226
White_Male_40_to_49_years White_Male_50_to_64_years
30.083073 55.343121
White_Male_65_years_and_over Black_Female_10_to_19_years
27.351523 140.154114
Black_Female_20_to_29_years Black_Female_30_to_39_years
56.959351 171.914269
Black_Female_40_to_49_years Black_Female_50_to_64_years
46.707169 71.514828
Black_Female_65_years_and_over Black_Male_10_to_19_years
106.967399 131.486665
Black_Male_20_to_29_years Black_Male_30_to_39_years
63.713636 183.271248
Black_Male_40_to_49_years Black_Male_50_to_64_years
43.494574 66.342952
Black_Male_65_years_and_over Other_Female_10_to_19_years
92.090941 184.637460
Other_Female_20_to_29_years Other_Female_30_to_39_years
51.812396 63.776558
Other_Female_40_to_49_years Other_Female_50_to_64_years
141.953648 234.097628
Other_Female_65_years_and_over Other_Male_10_to_19_years
60.354538 212.258459
Other_Male_20_to_29_years Other_Male_30_to_39_years
59.985342 65.956192
Other_Male_40_to_49_years Other_Male_50_to_64_years
108.867459 384.831305
Other_Male_65_years_and_over Unemployment_rate
17.361666 1.829250
Poverty_rate Population_log
1.343519 3.838949
police_per_100k_lag
1.491501 vif_LOTT <- vif(lm_LOTT)
vif_LOTT <- vif_LOTT %>%
as_tibble() %>%
cbind(., names(vif_LOTT)) %>%
as_tibble()
colnames(vif_LOTT) <- c("VIF", "Variable")
max_vif_LOTT <- max(vif(lm_LOTT))[1] 2.608183[1] 384.8313\[\frac{1}{1-R_{i}^{2}}\]
vif_DONOHUE$Analysis <- "Analysis 1"
vif_LOTT$Analysis <- "Analysis 2"
vif_df <- rbind(vif_DONOHUE,
vif_LOTT)
vif_plot <- vif_df %>%
ggplot(aes(x = Analysis, y = VIF)) +
geom_jitter(width = 0.1, alpha = 0.5, size = 2) +
geom_hline(yintercept = 10, color = "red") +
scale_y_continuous(trans = 'log10',
limits = c(1,1000)) +
labs(title = "Variance inflation factors") +
theme_minimal() +
theme(axis.title.x = element_blank())
vif_plot
Synthesis
Data Visualization
Summary
Suggested Homework
Helpful Links
https://rpubs.com/rslbliss/fixed_effects
http://karthur.org/2019/implementing-fixed-effects-panel-models-in-r.html
https://stats.stackexchange.com/questions/99236/effects-in-panel-models-individual-time-or-twoways
LS0tCnRpdGxlOiAiT3BlbiBDYXNlIFN0dWRpZXM6IEV4YW1pbmF0aW9uIG9mIE11bHRpY29sbGluZWFyaXR5IEluZmx1ZW5jZSBvbiBJbmZlcmVuY2UgVXNpbmcgUmlnaHQtdG8tQ2FycnkgR3VuIExhdyBhbmQgVmlvbGVudCBDcmltZSBEYXRhIgphdXRob3I6ICJNaWNoYWVsIE9udGl2ZXJvcywgQ2FycmllIFdyaWdodCwgUGhELiIKY3NzOiBzdHlsZS5jc3MKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICBzZWxmX2NvbnRhaW5lZDogeWVzCiAgICBjb2RlX2Rvd25sb2FkOiB5ZXMKICAgIGhpZ2hsaWdodDogdGFuZ28KICAgIG51bWJlcl9zZWN0aW9uczogbm8KICAgIHRoZW1lOiBjb3NtbwogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCiAgcGRmX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKICB3b3JkX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKLS0tCgo8c3R5bGU+CiNUT0MgewogIGJhY2tncm91bmQ6IHVybCgiaHR0cHM6Ly9vcGVuY2FzZXN0dWRpZXMuZ2l0aHViLmlvL2ltZy9sb2dvLmpwZyIpOwogIGJhY2tncm91bmQtc2l6ZTogY29udGFpbjsKICBwYWRkaW5nLXRvcDogMjQwcHggIWltcG9ydGFudDsKICBiYWNrZ3JvdW5kLXJlcGVhdDogbm8tcmVwZWF0Owp9Cjwvc3R5bGU+CgoKLS0tCgoKYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9CmtuaXRyOjpvcHRzX2NodW5rJHNldChpbmNsdWRlID0gVFJVRSwgY29tbWVudCA9IE5BLCBlY2hvID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgIG1lc3NhZ2UgPSBGQUxTRSwgd2FybmluZyA9IEZBTFNFLCBjYWNoZSA9IEZBTFNFLCBmaWcud2lkdGg9MTAsIGZpZy5oZWlnaHQ9NywKICAgICAgICAgICAgICAgICAgICAgIGZpZy5hbGlnbiA9ICJjZW50ZXIiLCBvdXQud2lkdGggPSAnOTAlJykKbGlicmFyeShoZXJlKQpsaWJyYXJ5KGtuaXRyKQpgYGAKCiMjIyMgey5vdXRsaW5lIH0KYGBge3IsIGVjaG8gPSBGQUxTRSwgb3V0LndpZHRoID0gIjgwMCBweCJ9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmU6OmhlcmUoImltZyIsICJtYWlucGxvdC5wbmciKSkKYGBgCgojIyMjCgojIyB7LmRpc2NsYWltZXJfYmxvY2t9CgoqKkRpc2NsYWltZXIqKjogVGhlIHB1cnBvc2Ugb2YgdGhlIFtPcGVuIENhc2UgU3R1ZGllc10oaHR0cHM6Ly9vcGVuY2FzZXN0dWRpZXMuZ2l0aHViLmlvKXt0YXJnZXQ9Il9ibGFuayJ9IHByb2plY3QgaXMgKip0byBkZW1vbnN0cmF0ZSB0aGUgdXNlIG9mIHZhcmlvdXMgZGF0YSBzY2llbmNlIG1ldGhvZHMsIHRvb2xzLCBhbmQgc29mdHdhcmUgaW4gdGhlIGNvbnRleHQgb2YgbWVzc3ksIHJlYWwtd29ybGQgZGF0YSoqLiBBIGdpdmVuIGNhc2Ugc3R1ZHkgZG9lcyBub3QgY292ZXIgYWxsIGFzcGVjdHMgb2YgdGhlIHJlc2VhcmNoIHByb2Nlc3MsIGlzIG5vdCBjbGFpbWluZyB0byBiZSB0aGUgbW9zdCBhcHByb3ByaWF0ZSB3YXkgdG8gYW5hbHl6ZSBhIGdpdmVuIGRhdGEgc2V0LCBhbmQgc2hvdWxkIG5vdCBiZSB1c2VkIGluIHRoZSBjb250ZXh0IG9mIG1ha2luZyBwb2xpY3kgZGVjaXNpb25zIHdpdGhvdXQgZXh0ZXJuYWwgY29uc3VsdGF0aW9uIGZyb20gc2NpZW50aWZpYyBleHBlcnRzLiAKCiMjIHsubGlzY2VuY2VfYmxvY2t9CgpUaGlzIHdvcmsgaXMgbGljZW5zZWQgdW5kZXIgdGhlIENyZWF0aXZlIENvbW1vbnMgQXR0cmlidXRpb24tTm9uQ29tbWVyY2lhbCAzLjAgWyhDQyBCWS1OQyAzLjApXShodHRwczovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnktbmMvMy4wL3VzLyl7dGFyZ2V0PSJfYmxhbmsifSAgVW5pdGVkIFN0YXRlcyBMaWNlbnNlLgoKIyAqKk1vdGl2YXRpb24qKgoqKiogCgpUaGlzIGNhc2Ugc3R1ZHkgd2lsbCBpbnRyb2R1Y2UgdGhlIHRvcGljIG9mIG11bHRpY29saW5lYXJpdHkuIFdlIHdpbGwgZG8gc28gYnkgc2hvd2Nhc2luZyBhIHJlYWwgd29ybGQgZXhhbXBsZSB3aGVyZSBtdWx0aWNvbGluZWFyaXR5IGluIHBhcnQgcmVzdWx0ZWQgaW4gaGlzdG9yaWNhbGx5IGNvbnRyaXZlcnNpYWwgYW5kIGNvbmZsaWN0aW5nIGZpbmRpbmdzIGFib3V0IHRoZSBpbmZsdWVuY2Ugb2YgdGhlIGFkb3B0aW9uIG9mIHJpZ2h0LXRvLWNhcnJ5IChSVEMpIGNvbmNlYWxlZCBoYW5kZ3VuIGxhd3Mgb24gdmlvbGVudCBjcmltZSByYXRlcyBpbiB0aGUgVW5pdGVkIFN0YXRlcy4gCgpXZSB3aWxsIGZvY3VzIG9uIHR3byBhcnRpY2xlczoKCjEpIFRoZSBmaXJzdCBhbmFseXNpcyBieSBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifSBwdWJsaXNoZWQgaW4gMTk5NiBzdWdnZXN0cyB0aGF0IFJUQyBsYXdzIHJlZHVjZSB2aW9sZW50IGNyaW1lLiBMb3R0IGF1dGhvcmVkIGEgYm9vayBleHRlbmRpbmcgdGhlc2UgZmluZGluZ3MgaW4gMTk5OCBjYWxsZWQgWyoqKk1vcmUgR3VucywgTGVzcyBDcmltZSoqKl0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvTW9yZV9HdW5zLF9MZXNzX0NyaW1lKXt0YXJnZXQ9Il9ibGFuayJ9LgoKYGBge3IsIGVjaG89RkFMU0UsIG91dC5oZWlnaHQgPSAnMTAwJScsIG91dC53aWR0aCA9ICcxMDAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAiTG90dC5wbmciKSkKYGBgCgoyKSBUaGUgc2Vjb25kIGFuYWx5c2lzIGlzIGEgcmVjZW50IGFydGljbGUgYnkgW0Rvbm9odWUsIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpe3RhcmdldD0iX2JsYW5rIn0gcHVibGlzaGVkIGluIDIwMTcgdGhhdCBzdWdnZXN0cyB0aGF0IFJUQyBsYXdzIGluY3JlYXNlIHZpb2xlbnQgY3JpbWUuIERvbm9odWUgaGFzIGFsc28gcHVibGlzaGVkIHByZXZpb3VzIGFydGljbGVzIHdpdGggdGl0bGVzIHN1Y2ggYXMgWyoqKiJTaG9vdGluZyBkb3duIHRoZSAiTW9yZSBHdW5zLCBMZXNzIENyaW1lIiBIeXBvdGhlc2lzKioqXShodHRwczovL3d3dy5qc3Rvci5vcmcvc3RhYmxlLzEyMjk2MDM/c2VxPTEpe3RhcmdldD0iX2JsYW5rIn0gCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJEb25vaHVlLnBuZyIpKQpgYGAKClRoaXMgaGFzIGJlZW4gYSBjb250cm92ZXJzaWFsIHRvcGljIGFzIG1hbnkgb3RoZXIgYXJ0aWNsZXMgYWxzbyBoYWQgY29uZmxpY3RpbmcgcmVzdWx0cy4gU2VlIFtoZXJlXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9Nb3JlX0d1bnMsX0xlc3NfQ3JpbWUpe3RhcmdldD0iX2JsYW5rIn0gZm9yIGEgbGlzdCBvZiBzdHVkaWVzLgoKVGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFydGljbGUgZGlzY3Vzc2VzIGhvdyB0aGVyZSBhcmUgbWFueSBvdGhlciBpbXBvcnRhbnQgbWV0aG9kb2xpY2FsIGFzcGVjdHMgYmVzaWRlcyBtdWx0aWNvbGluZWFyaXR5IHRoYXQgY291bGQgYWNjb3VudCBmb3IgdGhlIGhpc3RvcmljYWxseSBjb25mbGljdGluZyByZXN1bHRzIGluIHRoZXNlIHByZXZpb3VzIHBhcGVycy4KCkluIGZhY3QsIG5lYXJseSBldmVyeSBhc3BlY3Qgb2YgdGhlIGRhdGEgYW5hbHlzaXMgcHJvY2VzcyB3YXMgZGlmZmVyZW50IGJldHdlZW4gdGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFuYWx5c2lzIGFuZCB0aGUgW0xvdHQgYW5kIE11c3RhcmRdKGh0dHBzOi8vY2hpY2Fnb3VuYm91bmQudWNoaWNhZ28uZWR1L2NnaS92aWV3Y29udGVudC5jZ2k/YXJ0aWNsZT0xMTUwJmNvbnRleHQ9bGF3X2FuZF9lY29ub21pY3Mpe3RhcmdldD0iX2JsYW5rIn0gYW5hbHlzaXMuCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICc3NSUnLCBvdXQud2lkdGggPSAnNzUlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAiRWR1Y2F0aW9uYWxfR3JhcGhpYzEuanBnIikpCmBgYAoKSG93ZXZlciwgd2Ugd2lsbCBmb2N1cyBwYXJ0aWN1bGFybHkgb24gbXVsdGljb2xpbmVhcml0eSBhbmQgd2Ugd2lsbCBleHBsb3JlIGhvdyBpdCBjYW4gaW5mbHVlbmNlIGxpbmVhciByZWdyZXNzaW9uIGFuYWx5c2VzIGFuZCByZXN1bHQgaW4gZGlmZmVyZW50IGNvbmNsdXNpb25zLiAKClRoaXMgYW5hbHlzaXMgd2lsbCBkZW1vbnN0cmF0ZSBob3cgbWV0aG9kb2xvZ2ljYWwgZGV0YWlscyBjYW4gYmUgY3JpdGljYWxseSBpbmZsdWVudGlhbCBmb3Igb3VyIG92ZXJhbGwgY29uY2x1c2lvbnMgYW5kIGNhbiByZXN1bHQgaW4gaW1wb3J0YW50IHBvbGljeSByZWxhdGVkIGNvbnNlcXVlbmNlcy4gVGhpcyBbYXJ0aWNsZV0oKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9KSB3aWxsIHByb3ZpZGUgYSBiYXNpcyBmb3IgdGhlIG1vdGl2YXRpb24uIAoKIyMjIyB7LnJlZmVyZW5jZV9ibG9ja30KCkpvaG4gSi4gRG9ub2h1ZSBldCBhbC4sIFJpZ2h04oCQdG/igJBDYXJyeSBMYXdzIGFuZCBWaW9sZW50IENyaW1lOiBBIENvbXByZWhlbnNpdmUgQXNzZXNzbWVudCBVc2luZyBQYW5lbCBEYXRhIGFuZCBhIFN0YXRl4oCQTGV2ZWwgU3ludGhldGljIENvbnRyb2wgQW5hbHlzaXMuICpKb3VybmFsIG9mIEVtcGlyaWNhbCBMZWdhbCBTdHVkaWVzKiwgMTYsMiAoMjAxOSkuCgpEYXZpZCBCLiBNdXN0YXJkICYgSm9obiBMb3R0LiBDcmltZSwgRGV0ZXJyZW5jZSwgYW5kIFJpZ2h0LXRvLUNhcnJ5IENvbmNlYWxlZCBIYW5kZ3Vucy4gKkNvYXNlLVNhbmRvciBJbnN0aXR1dGUgZm9yIExhdyAmIEVjb25vbWljcyogV29ya2luZyBQYXBlciBOby4gNDEsICgxOTk2KS4KCiMjIyMKCgpIZXJlIHlvdSBjYW4gc2VlIHRoZSBkaWZmZXJlbmNlcyBpbiB0aGUgZGF0YSB1c2VkIGluIHRoZSBmZWF0dXJlZCBSVEMgYXJ0aWNsZXM6CgoKYGBge3IsIGVjaG89RkFMU0UsIG91dC5oZWlnaHQgPSAnMTAwJScsIG91dC53aWR0aCA9ICcxMDAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCdEb25vaHVlX1RhYmxlMi5wbmcnKSkKYGBgCgoKV2Ugd2lsbCBwZXJmb3JtIGFuYWx5c2VzIHNpbWlsYXIgdG8gdGhvc2UgaW4gdGhlc2UgYXJ0aWNsZXMsIGhvd2V2ZXIgKip3ZSB3aWxsIG5vdCB0cnkgdG8gcmVjcmVhdGUgdGhlbSoqLCBpbnN0ZWFkIHdlIHdpbGwgc2ltcGxpZnkgb3VyIGFuYWx5c2lzIHRvIGFsbG93IHVzIHRvIGZvY3VzIG9uIG11bHRpY29saW5lYXJpdHkuCgoKVGhlcmVmb3JlIHdlIHdpbGwgdXNlIGEgc3Vic2V0IG9mIHRoZSBsaXN0ZWQgZXhwbGFuYXRvcnkgdmFyaWFibGVzIGFuZCB0aGV5IHdpbGwgYmUgY29uc2lzdGVudCBmb3IgYm90aCBhbmFseXNlcyB0aGF0IHdlIHdpbGwgcGVyZm9ybSwgd2l0aCB0aGUgZXhjZXB0aW9uIHRoYXQgb25lIGFuYWx5c2lzIHdpbGwgaGF2ZSA2IGRlbW9ncmFwaGljIHZhcmlhYmxlcyBsaWtlIHRoZSBhbmFseXNpcyBpbiB0aGUgW0Rvbm9odWUsIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpe3RhcmdldD0iX2JsYW5rIn0gYXJ0aWNsZSBhbmQgdGhlIG90aGVyIHdpbGwgaGF2ZSAzNiBkZW1vZ3JwYWhpYyB2YXJpYWJsZXMgbGlrZSB0aGUgYW5hbHlzaXMgaW4gdGhlIFtMb3R0IGFuZCBNdXN0YXJkXShodHRwczovL2NoaWNhZ291bmJvdW5kLnVjaGljYWdvLmVkdS9jZ2kvdmlld2NvbnRlbnQuY2dpP2FydGljbGU9MTE1MCZjb250ZXh0PWxhd19hbmRfZWNvbm9taWNzKXt0YXJnZXQ9Il9ibGFuayJ9IGFydGljbGUuCgoKIyAqKk1haW4gUXVlc3Rpb24qKgoqKiogCgojIyMjIHsubWFpbl9xdWVzdGlvbl9ibG9ja30KPGI+PHU+IE91ciBtYWluIHF1ZXN0aW9uOiA8L3U+PC9iPgoKMSkgSG93IGRvZXMgdGhlIGluY2x1c2lvbiBvZiBkaWZmZXJlbnQgbnVtYmVycyBvZiBhZ2UgZ3JvdXBzIGluZmx1ZW5jZSB0aGUgcmVzdWx0cyBvZiBhbiBhbmFseXNpcyBvZiByaWdodCB0byBjYXJyeSBsYXdzIGFuZCB2aW9sZW5jZSByYXRlcz8KCiMjIyMKCgojICoqTGVhcm5pbmcgT2JqZWN0aXZlcyoqIAoqKiogCgo8dT4qKlN0YXRpc3RpY2FsIExlYXJuaW5nIE9iamVjdGl2ZXM6Kio8L3U+IAoKSW4gdGhpcyBjYXNlIHN0dWR5LCBzdHVkZW50cyB3aWxsIGxlYXJuOiAgCjEpIHdoYXQgbXVsdGljb2xpbmVhcml0eSBpcyBhbmQgaG93IGl0IGNhbiBpbmZsdWVuY2UgbGluZWFyIHJlZ3Jlc3Npb24gY29lZmZpY2llbnRzICAKMikgaG93IHRvIGxvb2sgZm9yIHRoZSBwcmVzZW5jZSBvZiBtdWx0aWNvbGluYXJpdHkgIAozKSB0aGUgZGlmZmVyZW5jZSBiZXR3ZWVuIG11bHRpY29saW5lYXJpdHkgYW5kIGNvcnJlbGF0aW9uICAKCjx1PioqRGF0YSBzY2llbmNlIExlYXJuaW5nIE9iamVjdGl2ZXM6Kio8L3U+CgoxKSBqb2luaW5nIGRhdGEgZnJvbSBtdWx0aXBsZSBzb3VyY2VzIChkcGx5cikgIAoyKSByZXNoYXBpbmcgZGF0YSBpbnRvIGRpZmZlcmVudCBmb3JtYXRzICh0aWR5cikgIAoyKSB2aXN1YWxpemF0aW9ucyAoZ2dwbG90MikgIAoKCldlIHdpbGwgZXNwZWNpYWxseSBmb2N1cyBvbiB1c2luZyBwYWNrYWdlcyBhbmQgZnVuY3Rpb25zIGZyb20gdGhlIFtgVGlkeXZlcnNlYF0oaHR0cHM6Ly93d3cudGlkeXZlcnNlLm9yZy8pe3RhcmdldD0iX2JsYW5rIn0sIHN1Y2ggYXMgYGRwbHlyYCBhbmQgYGdncGxvdDJgLiBUaGUgdGlkeXZlcnNlIGlzIGEgbGlicmFyeSBvZiBwYWNrYWdlcyBjcmVhdGVkIGJ5IFJTdHVkaW8uIFdoaWxlIHNvbWUgc3R1ZGVudHMgbWF5IGJlIGZhbWlsaWFyIHdpdGggcHJldmlvdXMgUiBwcm9ncmFtbWluZyBwYWNrYWdlcywgdGhlc2UgcGFja2FnZXMgbWFrZSBkYXRhIHNjaWVuY2UgaW4gUiBlc3BlY2lhbGx5IGVmZmljaWVudC4KCgpgYGB7ciwgb3V0LndpZHRoID0gIjIwJSIsIGVjaG8gPSBGQUxTRSwgZmlnLmFsaWduID0iY2VudGVyIn0KaW5jbHVkZV9ncmFwaGljcygiaHR0cHM6Ly90aWR5dmVyc2UudGlkeXZlcnNlLm9yZy9sb2dvLnBuZyIpCmBgYAoKIyAqKkNvbnRleHQqKgoqKioKClNvIHdoYXQgZXhhY3RseSBpcyBhICoqcmlnaHQtdG8tY2FycnkgbGF3Kio/CgpJdCBpcyBhIGxhdyB0aGF0c3BlY2lmaWVzIGlmIGFuZCBob3cgY2l0aXplbnMgYXJlIGFsbG93ZWQgdG8gaGF2ZSBhIGZpcmVhcm0gb24gdGhlaXIgcGVyc29uIG9yIG5lYXJieSAoZm9yIGV4YW1wbGUgaW4gdGhlIGNpdGl6ZW4ncyBjYXIpIGluIHB1YmxpYy4gCgpUaGUgW1NlY29uZCBBbWVuZG1lbnRdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1NlY29uZF9BbWVuZG1lbnRfdG9fdGhlX1VuaXRlZF9TdGF0ZXNfQ29uc3RpdHV0aW9uKXt0YXJnZXQ9Il9ibGFuayJ9IHRvIHRoZSBVbml0ZWQgU3RhdGVzIENvbnN0aXR1dGlvbiBndWFyYW50ZWVzIHRoZSByaWdodCB0byAia2VlcCBhbmQgYmVhciBhcm1zIi4gVGhlIGFtZW5kbWVudCB3YXMgcmF0aWZpZWQgaW4gMTc5MSBhcyBwYXJ0IG9mIHRoZSBbQmlsbCBvZiBSaWdodHNdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1VuaXRlZF9TdGF0ZXNfQmlsbF9vZl9SaWdodHMpe3RhcmdldD0iX2JsYW5rIn0uCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICc1MCUnLCBvdXQud2lkdGggPSAnNTAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcygiaHR0cHM6Ly91cGxvYWQud2lraW1lZGlhLm9yZy93aWtpcGVkaWEvY29tbW9ucy83Lzc5L0JpbGxfb2ZfUmlnaHRzX1BnMW9mMV9BQy5qcGciKQpgYGAKCkhvd2V2ZXIsIHRoZXJlIGFyZSBubyBmZWRlcmFsIGxhd3MgYWJvdXQgY2FycnlpbmcgZmlyZWFybXMgaW4gcHVibGljLiAKClRoZXNlIGxhd3MgYXJlIGNyZWF0ZWQgYW5kIGVuZm9yY2VkIGF0IHRoZSBzdGF0ZSBsZXZlbC4gU2F0ZXMgdmFyeSBncmVhdGx5IGluIHRoZWlyIGxhd3MgYWJvdXQgdGhlIHJpZ2h0IHRvIGNhcnJ5IGZpcmVhcm1zLiBTb21lIHJlcXVpcmUgZXh0ZW5zaXZlIGVmZm9ydCB0byBvYnRhaW4gYSBwZXJtaXQgdG8gbGVnYWxseSBjYXJyeSBhIGZpcmVhcm0sIHdoaWxlIG90aGVyIHN0YXRlcyByZXF1aXJlIHZlcnkgbWluaW1hbCBlZmZvcnQgdG8gbGVnYWxseSBjYXJyeSBhIGZpcmVhcm0uCgoKQWNjb3JkaW5nIHRvIFdpa2lwZWRpYSBhYm91dCB0aGUgaGlzdG9yeSBvZiByaWdodC10by1jYXJyeSBwb2xpY2llcyBpbiB0aGUgVW5pdGVkIFN0YXRlczoKCj4gUHVibGljIHBlcmNlcHRpb24gb24gY29uY2VhbGVkIGNhcnJ5IHZzIG9wZW4gY2FycnkgaGFzIGxhcmdlbHkgZmxpcHBlZC4gSW4gdGhlIGVhcmx5IGRheXMgb2YgdGhlIFVuaXRlZCBTdGF0ZXMsIG9wZW4gY2Fycnlpbmcgb2YgZmlyZWFybXMsIGxvbmcgZ3VucyBhbmQgcmV2b2x2ZXJzIHdhcyBhIGNvbW1vbiBhbmQgd2VsbC1hY2NlcHRlZCBwcmFjdGljZS4gU2VlaW5nIGd1bnMgY2FycmllZCBvcGVubHkgd2FzIG5vdCBjb25zaWRlcmVkIHRvIGJlIGFueSBjYXVzZSBmb3IgYWxhcm0uIFRoZXJlZm9yZSwgYW55b25lIHdobyB3b3VsZCBjYXJyeSBhIGZpcmVhcm0gYnV0IGF0dGVtcHQgdG8gY29uY2VhbCBpdCB3YXMgY29uc2lkZXJlZCB0byBoYXZlIHNvbWV0aGluZyB0byBoaWRlLCBhbmQgcHJlc3VtZWQgdG8gYmUgYSBjcmltaW5hbC4gRm9yIHRoaXMgcmVhc29uLCBjb25jZWFsZWQgY2Fycnkgd2FzIGRlbm91bmNlZCBhcyBhIGRldGVzdGFibGUgcHJhY3RpY2UgaW4gdGhlIGVhcmx5IGRheXMgb2YgdGhlIFVuaXRlZCBTdGF0ZXMuCgo+IENvbmNlYWxlZCB3ZWFwb25zIGJhbnMgd2VyZSBwYXNzZWQgaW4gS2VudHVja3kgYW5kIExvdWlzaWFuYSBpbiAxODEzLiAoSW4gdGhvc2UgZGF5cyBvcGVuIGNhcnJ5IG9mIHdlYXBvbnMgZm9yIHNlbGYtZGVmZW5zZSB3YXMgY29uc2lkZXJlZCBhY2NlcHRhYmxlOyBjb25jZWFsZWQgY2Fycnkgd2FzIGRlbm91bmNlZCBhcyB0aGUgcHJhY3RpY2Ugb2YgY3JpbWluYWxzLikgQnkgMTg1OSwgSW5kaWFuYSwgVGVubmVzc2VlLCBWaXJnaW5pYSwgQWxhYmFtYSwgYW5kIE9oaW8gaGFkIGZvbGxvd2VkIHN1aXQuIEJ5IHRoZSBlbmQgb2YgdGhlIG5pbmV0ZWVudGggY2VudHVyeSwgc2ltaWxhciBsYXdzIHdlcmUgcGFzc2VkIGluIHBsYWNlcyBzdWNoIGFzIFRleGFzLCBGbG9yaWRhLCBhbmQgT2tsYWhvbWEsIHdoaWNoIHByb3RlY3RlZCBzb21lIGd1biByaWdodHMgaW4gdGhlaXIgc3RhdGUgY29uc3RpdHV0aW9ucy4gQmVmb3JlIHRoZSBtaWQgMTkwMHMsIG1vc3QgVS5TLiBzdGF0ZXMgaGFkIHBhc3NlZCBjb25jZWFsZWQgY2FycnkgbGF3cyByYXRoZXIgdGhhbiBiYW5uaW5nIHdlYXBvbnMgY29tcGxldGVseS4gVW50aWwgdGhlIGxhdGUgMTk5MHMsIG1hbnkgU291dGhlcm4gc3RhdGVzIHdlcmUgZWl0aGVyICJOby1Jc3N1ZSIgb3IgIlJlc3RyaWN0aXZlIE1heS1Jc3N1ZSIuIFNpbmNlIHRoZW4sIHRoZXNlIHN0YXRlcyBoYXZlIGxhcmdlbHkgZW5hY3RlZCAiU2hhbGwtSXNzdWUiIGxpY2Vuc2luZyBsYXdzLCB3aXRoIG51bWVyb3VzIHN0YXRlcyBsZWdhbGl6aW5nICJVbnJlc3RyaWN0ZWQgY29uY2VhbGVkIGNhcnJ5Ii4KClNlZSBbaGVyZV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvSGlzdG9yeV9vZl9jb25jZWFsZWRfY2FycnlfaW5fdGhlX1UuUy4pe3RhcmdldD0iX2JsYW5rIn0gZm9yIG1vcmUgaW5mb3JtYXRpb24uCgpIZXJlIGFyZSB0aGUgZ2VuZXJhbCBjYXRlZ29yaWVzIG9mIFJpZ2h0IHRvIENhcnJ5IExhd3M6CgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJSVEMucG5nIikpCmBgYApbc291cmNlXShodHRwczovL3d3dy5ucmFpbGEub3JnL2d1bi1sYXdzLyl7dGFyZ2V0PSJfYmxhbmsifQoKCmBgYHtyLCBlY2hvPUZBTFNFLCBvdXQuaGVpZ2h0ID0gJzEwMCUnLCBvdXQud2lkdGggPSAnMTAwJScsIGZpZy5hbGlnbj0nY2VudGVyJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgIlJUQ19tYXAucG5nIikpCmBgYAoKW3NvdXJjZV0oaHR0cHM6Ly93d3cubnJhaWxhLm9yZy9ndW4tbGF3cy8pe3RhcmdldD0iX2JsYW5rIn0KCllvdSBjYW4gc2VlIHRoYXQgbm9uZSBvZiB0aGUgZmlmdHkgc3RhdGVzIGhhdmUgbm8taXNzdWUgbGF3cyBjdXJyZW50bHksIG1lYW5pbmcgdGhhdCBhbGwgc3RhdGVzIGFsbG93IHRoZSByaWdodCB0byBjYXJyeSBmaXJlYXJtcyBhdCBsZWFzdCBpbiBzb21lIHdheSwgaG93ZXZlciB0aGUgbGV2ZWwgb2YgcmVzdHJpY3Rpb25zIGlzIGRyYW1hdGljYWxseSBkaWZmZXJlbnQgZnJvbSBvbmUgc3RhdGUgdG8gYW5vdGhlci4KCkhlcmUgeW91IGNhbiBzZWUgaG93IHRoZXNlIGxhd3MgaGF2ZSBjaGFuZ2VkIG92ZXIgdGltZSBhcm91bmQgdGhlIGNvdW50cnk6CmBgYHtyLCBlY2hvPUZBTFNFLCBvdXQuaGVpZ2h0ID0gJzEwMCUnLCBvdXQud2lkdGggPSAnMTAwJScsIGZpZy5hbGlnbj0nY2VudGVyJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImh0dHBzOi8vdXBsb2FkLndpa2ltZWRpYS5vcmcvd2lraXBlZGlhL2NvbW1vbnMvdGh1bWIvNS81YS9SaWdodF90b19DYXJyeSUyQ190aW1lbGluZS5naWYvNjIwcHgtUmlnaHRfdG9fQ2FycnklMkNfdGltZWxpbmUuZ2lmIikKYGBgCgpUaGVyZSBpcyB2YXJpYXRpb24gZnJvbSBzdGF0ZSB0byBzdGF0ZSBldmVuIHdpdGhpbiB0aGUgc2FtZSBnZW5lcmFsIGNhdGVnb3J5OgoKRm9yIGV4YW1wbGUgaGVyZSBhcmUgdGhlIFtjdXJyZW50IGNhcnJ5IGxhd3MgaW4gSWRhaG9dKGh0dHBzOi8vd3d3Lm5yYWlsYS5vcmcvZ3VuLWxhd3Mvc3RhdGUtZ3VuLWxhd3MvaWRhaG8vKSB3aGljaCBpcyBjb25zaWRlcmVkIGFuICJVbnJlc3RyaWN0ZWQgLSBubyBwZXJtaXQgcmVxdWlyZWQiIHN0YXRlOgoKPklkYWhvIHBlcm1pdHMgdGhlIG9wZW4gY2Fycnlpbmcgb2YgZmlyZWFybXMuCgo+SWRhaG8gbGF3IHBlcm1pdHMgYm90aCByZXNpZGVudHMgYW5kIG5vbi1yZXNpZGVudHMgd2hvIGFyZSBhdCBsZWFzdCAxOCB5ZWFycyBvbGQgdG8gY2FycnkgY29uY2VhbGVkIHdlYXBvbnMsIHdpdGhvdXQgYSBjYXJyeSBsaWNlbnNlLCBvdXRzaWRlIHRoZSBsaW1pdHMgb2Ygb3IgY29uZmluZXMgb2YgYW55IGNpdHksIHByb3ZpZGVkIHRoZSBwZXJzb24gaXMgbm90IG90aGVyd2lzZSBkaXNxdWFsaWZpZWQgZnJvbSBiZWluZyBpc3N1ZWQgYSBsaWNlbnNlIHRvIGNhcnJ5LgoKPkEgcGVyc29uIG1heSBhbHNvIGNhcnJ5IGNvbmNlYWxlZCB3ZWFwb25zIG9uIG9yIGFib3V0IGhpcyBvciBoZXIgcGVyc29uLCB3aXRob3V0IGEgbGljZW5zZSwgaW4gdGhlIHBlcnNvbuKAmXMgb3duIHBsYWNlIG9mIGFib2RlIG9yIGZpeGVkIHBsYWNlIG9mIGJ1c2luZXNzLCBvbiBwcm9wZXJ0eSBpbiB3aGljaCB0aGUgcGVyc29uIGhhcyBhbnkgb3duZXJzaGlwIG9yIGxlYXNlaG9sZCBpbnRlcmVzdCwgb3Igb24gcHJpdmF0ZSBwcm9wZXJ0eSB3aGVyZSB0aGUgcGVyc29uIGhhcyBwZXJtaXNzaW9uIHRvIGNhcnJ5IGZyb20gYW55IHBlcnNvbiB3aG8gaGFzIGFuIG93bmVyc2hpcCBvciBsZWFzZWhvbGQgaW50ZXJlc3QgaW4gdGhhdCBwcm9wZXJ0eS4gCgo+U3RhdGUgbGF3IGFsc28gYWxsb3dzIGFueSByZXNpZGVudCBvZiBJZGFobyBvciBhIGN1cnJlbnQgbWVtYmVyIG9mIHRoZSBhcm1lZCBmb3JjZXMgb2YgdGhlIFVuaXRlZCBTdGF0ZXMgdG8gY2FycnkgYSBjb25jZWFsZWQgaGFuZGd1biB3aXRob3V0IGEgbGljZW5zZSB0byBjYXJyeSwgcHJvdmlkZWQgdGhlIHBlcnNvbiBpcyBvdmVyIDE4IHllYXJzIG9sZCBhbmQgbm90IGRpc3F1YWxpZmllZCBmcm9tIGJlaW5nIGlzc3VlZCBhIGxpY2Vuc2UgdG8gY2FycnkgY29uY2VhbGVkIHdlYXBvbnMgdW5kZXIgc3RhdGUgbGF3LiBBbiBhbWVuZG1lbnQgdG8gc3RhdGUgbGF3IHRoYXQgdGFrZXMgZWZmZWN0IG9uIEp1bHkgMSwgMjAyMCBjaGFuZ2VzIHRoZSByZWZlcmVuY2UgaW4gdGhlIGFib3ZlIGxhdyBmcm9tIOKAnGEgcmVzaWRlbnQgb2YgSWRhaG/igJ0gdG8g4oCcYW55IGNpdGl6ZW4gb2YgdGhlIFVuaXRlZCBTdGF0ZXMu4oCdICAKCgpBbmQgaGVyZSBhcmUgdGhlIFtjdXJyZW50IGNhcnJ5IGxhd3MgaW4gQXJpem9uYV0oaHR0cHM6Ly93d3cubnJhaWxhLm9yZy9ndW4tbGF3cy9zdGF0ZS1ndW4tbGF3cy9hcml6b25hLykgd2hpY2ggaXMgYWxzbyBjb25zaWRlcmVkIGFuICJVbnJlc3RyaWN0ZWQtIC0gbm8gcGVybWl0IHJlcXVpcmVkIiBzdGF0ZToKCj4gQXJpem9uYSByZXNwZWN0cyB0aGUgcmlnaHQgb2YgbGF3IGFiaWRpbmcgY2l0aXplbnMgdG8gb3Blbmx5IGNhcnJ5IGEgaGFuZGd1bi4KCj4gQW55IHBlcnNvbiAyMSB5ZWFycyBvZiBhZ2Ugb3Igb2xkZXIsIHdobyBpcyBub3QgcHJvaGliaXRlZCBwb3NzZXNzb3IsIG1heSBjYXJyeSBhIHdlYXBvbiBvcGVubHkgb3IgY29uY2VhbGVkIHdpdGhvdXQgdGhlIG5lZWQgZm9yIGEgbGljZW5zZS4gQW55IHBlcnNvbiBjYXJyeWluZyB3aXRob3V0IGEgbGljZW5zZSBtdXN0IGFja25vd2xlZGdlIGFuZCBjb21wbHkgd2l0aCB0aGUgZGVtYW5kcyBvZiBhIGxhdyBlbmZvcmNlbWVudCBvZmZpY2VyIHdoZW4gYXNrZWQgaWYgaGUvc2hlIGlzIGNhcnJ5aW5nIGEgY29uY2VhbGVkIGRlYWRseSB3ZWFwb24sIGlmIHRoZSBvZmZpY2VyIGhhcyBpbml0aWF0ZWQgYW4gImludmVzdGlnYXRpb24iIHN1Y2ggYXMgYSB0cmFmZmljIHN0b3AuCgpOb3RpY2UgdGhhdCBjaXRpemVucyBpbiBJZGFobyBvbmx5IG5lZWQgdG8gYmUgMTggdG8gY2FycnkgYSBmaXJlYXJtLCB3aGVyZWFzIHRoZXkgbXVzdCBiZSAyMSBpbiBBcml6b25hLiAKCgpJbiBjb250cmFzdCBoZXJlIGlzIGFuIGV4YW1wbGUgb2YgW2N1cnJlbnQgY2FycnkgbGF3cyBpbiBNYXJ5bGFuZF0oaHR0cHM6Ly93d3cubnJhaWxhLm9yZy9ndW4tbGF3cy9zdGF0ZS1ndW4tbGF3cy9tYXJ5bGFuZC8pIHdoaWNoIGlzIGNvbnNpZGVyZWQgYSAiUmlnaHRzIFJlc3RyaWN0ZWQtVmVyeSBMaW1pdGVkIElzc3VlIiBzdGF0ZToKCj5DYXJyeWluZyBhbmQgVHJhbnNwb3J0YXRpb24gaW4gVmVoaWNsZXMKSXQgaXMgdW5sYXdmdWwgZm9yIGFueSBwZXJzb24gd2l0aG91dCBhIHBlcm1pdCB0byB3ZWFyIG9yIGNhcnJ5IGEgaGFuZGd1biwgb3Blbmx5IG9yIGNvbmNlYWxlZCwgdXBvbiBvciBhYm91dCBoaXMgcGVyc29uLiAgSXQgaXMgYWxzbyB1bmxhd2Z1bCBmb3IgYW55IHBlcnNvbiB0byBrbm93aW5nbHkgdHJhbnNwb3J0IGEgaGFuZGd1biBpbiBhbnkgdmVoaWNsZSB0cmF2ZWxpbmcgb24gcHVibGljIHJvYWRzLCBoaWdod2F5cywgd2F0ZXJ3YXlzIG9yIGFpcndheXMsIG9yIHVwb24gcm9hZHMgb3IgcGFya2luZyBsb3RzIGdlbmVyYWxseSB1c2VkIGJ5IHRoZSBwdWJsaWMuIFRoaXMgZG9lcyBub3QgYXBwbHkgdG8gYW55IHBlcnNvbiB3ZWFyaW5nLCBjYXJyeWluZyBvciB0cmFuc3BvcnRpbmcgYSBoYW5kZ3VuIHdpdGhpbiB0aGUgY29uZmluZXMgb2YgcmVhbCBlc3RhdGUgb3duZWQgb3IgbGVhc2VkIGJ5IGhpbSwgb3Igb24gd2hpY2ggaGUgcmVzaWRlcywgb3Igd2l0aGluIHRoZSBjb25maW5lcyBvZiBhIGJ1c2luZXNzIGVzdGFibGlzaG1lbnQgb3duZWQgb3IgbGVhc2VkIGJ5IGhpbS4KCj5QZXJtaXQgVG8gQ2FycnkKQXBwbGljYXRpb24gZm9yIGEgcGVybWl0IHRvIGNhcnJ5IGEgaGFuZGd1biBpcyBtYWRlIHRvIHRoZSBTZWNyZXRhcnkgb2YgU3RhdGUgUG9saWNlLiAgSW4gYWRkaXRpb24gdG8gdGhlIHByaW50ZWQgYXBwbGljYXRpb24gZm9ybSwgdGhlIGFwcGxpY2FudCBzaG91bGQgc3VibWl0IGEgbm90YXJpemVkIGxldHRlciBzdGF0aW5nIHRoZSByZWFzb25zIHdoeSBoZSBpcyBhcHBseWluZyBmb3IgYSBwZXJtaXQuCgoKYXZvY2Fkby4uLi5SaWdodCB0byBjYXJyeSBhbmQgY292aWQgbWFza3M/CgojICoqTGltaXRhdGlvbnMqKgoqKiogClRoZXJlIGFyZSBzb21lIGltcG9ydGFudCBjb25zaWRlcmF0aW9ucyByZWdhcmRpbmcgdGhpcyBkYXRhIGFuYWx5c2lzIHRvIGtlZXAgaW4gbWluZDogCgoxKSBXZSBkbyBub3QgdXNlIGFsbCBvZiB0aGUgZGF0YSB1c2VkIGJ5IGVpdGhlciB0aGUgIFtMb3R0IGFuZCBNdXN0YXJkXShodHRwczovL2NoaWNhZ291bmJvdW5kLnVjaGljYWdvLmVkdS9jZ2kvdmlld2NvbnRlbnQuY2dpP2FydGljbGU9MTE1MCZjb250ZXh0PWxhd19hbmRfZWNvbm9taWNzKXt0YXJnZXQ9Il9ibGFuayJ9IG9yIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFuYWx5c2VzLCBub3IgZG8gd2UgcGVyZm9ybSB0aGUgc2FtZSBhbmFseXNpcyBvZiBlYWNoIGFydGljbGUuIFdlIGluc3RlYWQgcGVyZm9ybSBhIG11Y2ggc2ltcGxlciBhbmFseXNpcyB3aXRoIGxlc3MgdmFyaWFibGVzIGZvciB0aGUgcHVycG9zZXMgb2YgaWxsdXN0cmF0aW9uIG9mIHRoZSBjb25jZXB0IG9mIG11bHRpY29sbGluZWFyaXR5IGFuZCBpdHMgaW5mbHVlbmNlIG9uIHJlZ3Jlc3Npb24gY29lZmZpY2llbnRzLCBub3QgdG8gcmVwcm9kdWNlIGVpdGhlciBhbmFseXNpcy4KCjIpIEJlY2F1c2Ugb3VyIGFuYWx5c2lzIGlzIGFuIG92ZXJzaW1wbGlmaWNhdGlvbiwgb3VyIGFuYWx5c2lzIHNob3VsZCBub3QgYmUgdXNlZCBmb3IgZGV0ZXJtaW5pbmcgcG9saWN5IGNoYW5nZXMsIGluc3RlYWQgd2Ugc3VnZ2VzdCB0aGF0IHVzZXJzIGNvbnN1bHQgd2l0aCBhIHNwZWNpYWxpc3QuCgoKV2Ugd291bGQgYWxzbyBsaWtlIHRvIG5vdGUgdGhhdC4uLkFWT0NBRE8KSXQgaXMgaW1wb3J0YW50IHRoYXQgd2UgZG8gbm90IHRyZWF0IHJhY2UgYXMgYW4gb2JqZWN0aXZlIG1lYXN1cmUuIERlc3BpdGUgdGhpcywgaXQgY2FuIGJlIHVzZWQgdG8gYWR2YW5jZSBzY2llbnRpZmljIGlucXVpcnkuIEZvciBtb3JlIGluZm9ybWF0aW9uIG9uIHRoaXMgdG9waWMsIHdlIGhhdmUgaW5jbHVkZWQgYSBsaW5rIHRvIGEgW3BhcGVyIG9uIHRoZSB1c2Ugb2YgcmFjZSBhcyBhIG1lYXN1cmUgaW4gZXBpZGVtaW9sb2d5XShodHRwczovL2FjYWRlbWljLm91cC5jb20vZXBpcmV2L2FydGljbGUvMjIvMi8xODcvNDU2OTQyKS4gCgoKV2Ugd2lsbCBiZWdpbiBieSBsb2FkaW5nIHRoZSBwYWNrYWdlcyB0aGF0IHdlIHdpbGwgbmVlZDoKCmBgYHtyfQpsaWJyYXJ5KGhlcmUpCmxpYnJhcnkocmVhZHhsKQpsaWJyYXJ5KHJlYWRyKQpsaWJyYXJ5KHBkZnRvb2xzKQpsaWJyYXJ5KGRwbHlyKQpsaWJyYXJ5KG1hZ3JpdHRyKQpsaWJyYXJ5KHRpZHlyKQpsaWJyYXJ5KHN0cmluZ3IpCgpsaWJyYXJ5KGNhcikgIyB2aWYgZnVuY3Rpb24KbGlicmFyeShwbG0pICMgZml4ZWQgZWZmZWN0IG1vZGVsLCBsaW5lYXIgcmVncmVzc2lvbgpsaWJyYXJ5KGJyb29tKSAjIHRpZHkgb3V0cHV0CmxpYnJhcnkodGlkeXZlcnNlKSAjIGdlbmVyYWwgd3JhbmdsaW5nIGZ1bmN0aW9ucwpsaWJyYXJ5KGNvd3Bsb3QpICMgdG8gcHJvZHVjZSBwbG90IG9mIHBsb3RzIApsaWJyYXJ5KEdHYWxseSkKbGlicmFyeShnZ3JlcGVsKQpsaWJyYXJ5KHNjYWxlcykKbGlicmFyeShsYXRleDJleHApCmxpYnJhcnkodmlyaWRpcykKbGlicmFyeShnZ2NvcnJwbG90KQpsaWJyYXJ5KHJzYW1wbGUpCgpzZXQuc2VlZCg5OTkpCmBgYAoKCiBQYWNrYWdlICAgfCBVc2UgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCi0tLS0tLS0tLS0gfC0tLS0tLS0tLS0tLS0KW2hlcmVdKGh0dHBzOi8vZ2l0aHViLmNvbS9qZW5ueWJjL2hlcmVfaGVyZSl7dGFyZ2V0PSJfYmxhbmsifSAgICAgICB8IHRvIGVhc2lseSBsb2FkIGFuZCBzYXZlIGRhdGEKW3JlYWRyXShodHRwczovL3JlYWRyLnRpZHl2ZXJzZS5vcmcvKXt0YXJnZXQ9Il9ibGFuayJ9ICAgICAgfCB0byBpbXBvcnQgdGhlIENTViBmaWxlIGRhdGEKW2Nhcl0gIHwgdG8gY2FsY3VsYXRlIHZpZiB2YWx1ZXMKClRoZSBmaXJzdCB0aW1lIHdlIHVzZSBhIGZ1bmN0aW9uLCB3ZSB3aWxsIHVzZSB0aGUgYDo6YCB0byBpbmRpY2F0ZSB3aGljaCBwYWNrYWdlIHdlIGFyZSB1c2luZy4gVW5sZXNzIHdlIGhhdmUgb3ZlcmxhcHBpbmcgZnVuY3Rpb24gbmFtZXMsIHRoaXMgaXMgbm90IG5lY2Vzc2FyeSwgYnV0IHdlIHdpbGwgaW5jbHVkZSBpdCBoZXJlIHRvIGJlIGluZm9ybWF0aXZlIGFib3V0IHdoZXJlIHRoZSBmdW5jdGlvbnMgd2Ugd2lsbCB1c2UgY29tZSBmcm9tLgoKCiMgKipXaGF0IGFyZSB0aGUgZGF0YT8qKgoqKioKCkJlbG93IGlzIGEgdGFibGUgZnJvbSB0aGUgW0Rvbm9odWUsIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpIHBhcGVyIHRoYXQgc2hvd3MgdGhlIGRhdGEgdXNlZCBpbiBib3RoIGFuYWx5c2VzLCB3aGVyZSBEQVcgc3RhbmRzIGZvciBbRG9ub2h1ZSwgZXQgYWwuXShodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZil7dGFyZ2V0PSJfYmxhbmsifSBhbmQgTE0gc3RhbmRzIGZvciBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifS4KCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJEb25vaHVlX0FwcGVuZGl4Si5wbmciKSkKYGBgCgpXZSB3aWxsIGJlIHVzaW5nIGEgc3Vic2V0IG9mIHRoZXNlIHZhcmlhYmxlcywgd2hpY2ggYXJlIGhpZ2hsaWdodGVkIGluIGdyZWVuOgoKCmBgYHtyLCBlY2hvPUZBTFNFLCBvdXQuaGVpZ2h0ID0gJzEwMCUnLCBvdXQud2lkdGggPSAnMTAwJScsIGZpZy5hbGlnbj0nY2VudGVyJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgIm91cmRhdGEucG5nIikpCmBgYAoKCiMgKipEYXRhIEltcG9ydCoqCioqKgoKCgojIyBEZW1vZ3JhcGhpYyBhbmQgUG9wdWxhdGlvbiBkYXRhCgpUbyBvYnRhaW4gaW5mb3JtYXRpb24gYWJvdXQgYWdlLCBzZXgsIGFuZCByYWNlLCBhbmQgb3ZlcmFsbCBwb3B1bGF0aW9uIHdlIHdpbGwgdXNlIFVTIENlbnN1cyBCdXJlYXUgZGF0YSwganVzdCBsaWtlIGJvdGggb2YgdGhlIGFydGljbGVzLiBUaGUgY2VzbnVzIGRhdGEgaXMgYXZhaWxhYmxlIGZvciBkaWZmZXJlbnQgdGltZSBzcGFucy4gSGVyZSBhcmUgdGhlIGxpbmtzIGZvciB0aGUgeWVhcnMgdXNlZCBpbiBvdXIgYW5hbHlzaXMuIFdlIHdpbGwgdXNlIGRhdGEgZnJvbSAxOTc3IHRvIDIwMTAuCgpEYXRhICAgfCBMaW5rICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCi0tLS0tLS0tLS0gfC0tLS0tLS0tLS0tLS0KKip5ZWFycyAxOTc3IHRvIDE5NzkqKiAgfCBbbGlua10oaHR0cHM6Ly93d3cyLmNlbnN1cy5nb3YvcHJvZ3JhbXMtc3VydmV5cy9wb3Blc3QvdGFibGVzLzE5MDAtMTk4MC9zdGF0ZS9hc3JoLykgIAoqKnllYXJzIDE5ODAgdG8gMTk4OSoqICB8IFtsaW5rXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90YWJsZXMvMTk4MC0xOTkwL2NvdW50aWVzL2FzcmgvKSAqIGNvdW50eSBkYXRhIHdhcyB1c2VkIGZvciB0aGlzIGRlY2FkZQoqKnllYXJzIDE5OTAgdG8gMTk5OSoqICB8IFtsaW5rXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90YWJsZXMvMTk5MC0yMDAwL3N0YXRlL2FzcmgvKQoqKnllYXJzIDIwMDAgdG8gMjAxMCoqICB8IFtsaW5rXShodHRwczovL3d3dy5jZW5zdXMuZ292L2RhdGEvZGF0YXNldHMvdGltZS1zZXJpZXMvZGVtby9wb3Blc3QvaW50ZXJjZW5zYWwtMjAwMC0yMDEwLXN0YXRlLmh0bWwpIDxicj4gW3RlY2huaWNhbCBkb2N1bWVudGF0aW9uXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90ZWNobmljYWwtZG9jdW1lbnRhdGlvbi9maWxlLWxheW91dHMvMjAwMC0yMDEwL2ludGVyY2Vuc2FsL3N0YXRlL3N0LWVzdDAwaW50LWFsbGRhdGEucGRmKQoKVG8gaW1wb3J0IHRoZSBkYXRhIHdlIHdpbGwgdXNlIHRoZSBgcmVhZF9jc3YoKWAgZnVuY3Rpb24gb2YgdGhlIGByZWFkcmAgcGFja2FnZSBmb3IgdGhlIGNzdiBmaWxlcy4gSW4gc29tZSBkZWNhZGVzLCB0aGVyZSBhcmUgc2VwYXJhdGUgZmlsZXMgZm9yIGVhY2ggeWVhciwgd2Ugd2lsbCByZWFkIGVhY2ggb2YgdGhlc2UgdG9nZXRoZXIgdXNpbmcgdGhlIGJhc2UgYGxpc3QuZmlsZXMoKWAgZnVuY3Rpb24gdG8gZ2V0IGFsbCBvZiB0aGUgbmFtZXMgZm9yIGVhY2ggZmlsZSBhbmQgdGhlbiB0aGUgYG1hcCgpYCBmdW5jdGlvbiBvZiB0aGUgYHB1cnJyYCBwYWNrYWdlIHRvIGFwcGx5IHRoZSBgcmVhZF9jc3YoKWAgZnVuY3Rpb24gb24gYWxsIG9mIHRoZSBmaWxlIHBhdGhzIGluIHRoZSBsaXN0IGNyZWF0ZWQgYnkgYGxpc3QuZmlsZXMoKWAuIEZvciB5ZWFycyB0aGF0IGFyZSB0eHQgZmlsZXMgd2Ugd2lsbCB1c2UgYHJlYWRfdGFibGUyKClgIGFsc28gZm8gdGhlIGByZWFkcmAgcGFja2FnZS4gVGhlIGByZWFkX3RhYmxlMigpYCBmdW5jdGlvbiwgdW5saWtlIHRoZSBgcmVhZF90YWJsZSgpYCwgIGFsbG93cyBmb3IgYW55IG51bWJlciBvZiB3aGl0ZXNwYWNlIGNoYXJhY3RlcnMgYmV0d2VlbiBjb2x1bW5zLCBhbmQgdGhlIGxpbmVzIGNhbiBiZSBvZiBkaWZmZXJlbnQgbGVuZ3Rocy4KCkFWT0NBRE8gSSBhbSBhIGJpdCBjb25mdXNlZCBhYm91dCB0aGUgbGFzdCBkZWNhZGUuLi4gaXQncyBvbmx5IG9uZSBmaWxlIGJ1dCBpdCBzZWVtcyB0byBuZWVkIG1hcC4uLgoKYGBge3J9CgpkZW1fNzdfNzkgPC0gcmVhZF9jc3YoImRvY3MvRGVtb2dyYXBoaWNzL0RlY2FkZV8xOTcwL3BlLTE5LmNzdiIsIHNraXAgPSA1KQoKZGVtXzgwXzg5IDwtIGxpc3QuZmlsZXMocmVjdXJzaXZlID0gVFJVRSwKICAgICAgICAgICAgICAgICAgcGF0aCA9ICJkb2NzL0RlbW9ncmFwaGljcy9EZWNhZGVfMTk4MC8iLAogICAgICAgICAgICAgICAgICBwYXR0ZXJuID0gIiouY3N2IiwKICAgICAgICAgICAgICAgICAgZnVsbC5uYW1lcyA9IFRSVUUpICU+JSAKICBtYXAofnJlYWRfY3N2KC4sIHNraXA9NSkpCgpkZW1fOTBfOTkgPC0gbGlzdC5maWxlcyhyZWN1cnNpdmUgPSBUUlVFLAogICAgICAgICAgICAgICAgICBwYXRoID0gImRvY3MvRGVtb2dyYXBoaWNzL0RlY2FkZV8xOTkwLyIsCiAgICAgICAgICAgICAgICAgIHBhdHRlcm4gPSAiKi50eHQiLAogICAgICAgICAgICAgICAgICBmdWxsLm5hbWVzID0gVFJVRSkgJT4lIAogIG1hcCh+cmVhZF90YWJsZTIoLiwgc2tpcCA9IDE0KSkKCgpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIG1hcF9kZihiaW5kX3Jvd3MpCgoKZGVtXzAwXzEwXzIgPC0gcmVhZF9jc3YoImRvY3MvRGVtb2dyYXBoaWNzL0RlY2FkZV8yMDAwL3N0LWVzdDAwaW50LWFsbGRhdGEuY3N2IikKCmRlbV8wMF8xMCA8LSBsaXN0LmZpbGVzKHJlY3Vyc2l2ZSA9IFRSVUUsCiAgICAgICAgICAgICAgICAgIHBhdGggPSAiZG9jcy9EZW1vZ3JhcGhpY3MvRGVjYWRlXzIwMDAvIiwKICAgICAgICAgICAgICAgICAgcGF0dGVybiA9ICIqLmNzdiIsCiAgICAgICAgICAgICAgICAgICBmdWxsLm5hbWVzID0gVFJVRSkgJT4lIAogICBtYXAofnJlYWRfY3N2KC4pKQoKaGVhZChkZW1fMDBfMTApCgpgYGAKCk5vdGljZSB0aGF0IHRoZSBgU1RBVEVgIHZhcmlhYmxlIGZvciB0aGUgZGVtb2dyYXBoaWMgZGF0YSBpcyBudW1lcmljLiBUaGF0IGlzIGJlY2F1c2UgaXQgaXMgZW5jb2RlZCBieSBbRmVkZXJhbCBJbmZvcm1hdGlvbiBQcm9jZXNzaW5nIFN0YW5kYXJkIChGSVBTKSBzdGF0ZSBjb2Rlc10oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvRmVkZXJhbF9JbmZvcm1hdGlvbl9Qcm9jZXNzaW5nX1N0YW5kYXJkX3N0YXRlX2NvZGUpe3RhcmdldD0iX2JsYW5rIi4gVGh1cyB3ZSBhbHNvIG5lZWQgdG8gaW1wb3J0IGRhdGEgIGFib3V0IEZJUFMgZW5jb2Rpbmcgc28gdGhhdCB3ZSBjYW4gaWRlbnRpZnkgd2hhdCBkYXRhIGNvcnJlc3BvbmRzIHRvIHdoYXQgc3RhdGUuCgoKIyNTdGF0ZSBGSVBTIGNvZGVzCgpUaGUgZm9sbG93aW5nIGRhdGEgd2FzIGRvd25sb2FkZWQgZnJvbSB0aGUgW1VTIENlbnN1cyBCdXJlYXVdKGh0dHBzOi8vd3d3LmNlbnN1cy5nb3YvZ2VvZ3JhcGhpZXMvcmVmZXJlbmNlLWZpbGVzLzIwMTQvZGVtby9wb3Blc3QvMjAxNC1nZW9jb2Rlcy1zdGF0ZS5odG1sKXt0YXJnZXQ9Il9ibGFuayJ9LgoKVG8gaW1wb3J0IHRoZSBkYXRhIHdlIHdpbGwgdXNlIHRoZSBgcmVhZF94bHMoKWAgZnVuY3Rpb24gb2YgdGhlIGByZWFkeGxgIHBhY2thZ2UuIFNpbmNlIHRoZSBmaXJzdCBmaXZlIGxpbmVzIG9mIHRoaXMgZXhjZWwgaXMgaW5mb3JtYXRpb24gYWJvdXQgdGhlIHNvdXJjZSBvZiB0aGUgZGF0YSBhbmQgd2hlbiBpdCB3YXMgcmVsZWFzZWQsIHdlIG5lZWQgdG8gc2tpcCBpbXBvcnRpbmcgdGhlc2UgbGluZXMgdXNpbmcgdGhlIGBza2lwYCBhcmd1bWVudCBzbyB0aGF0IHRoZSBkYXRhIGhhcyB0aGUgc2FtZSBudW1iZXIgb2YgY29sdW1ucyBmb3IgZWFjaCByb3cuIAoKYGBge3J9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJGSVBTLnBuZyIpKQoKYGBgCgpgYGB7cn0KU1RBVEVfRklQUyA8LSByZWFkX3hscygiZG9jcy9TdGF0ZV9GSVBTX2NvZGVzL3N0YXRlLWdlb2NvZGVzLXYyMDE0LnhscyIsIHNraXAgPSA1KQooU1RBVEVfRklQUykKYGBgCgojIyBQb2xpY2Ugc3RhZmZpbmcgZGF0YQpUaGUgZm9sbG93aW5nIGRhdGEgd2FzIGRvd25sb2FkZWQgZnJvbSB0aGUgW0ZlZGVyYWwgQnVyZWF1IG9mIEludmVzdGlnYXRpb25dKGh0dHBzOi8vY3JpbWUtZGF0YS1leHBsb3Jlci5mci5jbG91ZC5nb3YvZG93bmxvYWRzLWFuZC1kb2NzKS4gCgoKVGhlIGByZWFkX2NzdigpYCBmdW5jdGlvbiBvZiB0aGUgYHJlYWRyYCBwYWNrYWdlIGd1ZXNzZXMgd2hhdCB0aGUgY2xhc3MgaXMgZm9yIGVhY2ggdmFyaWFibGUsIGJ1dCBzb21ldGltZXMgaXQgbWFrZXMgbWlzdGFrZXMuIEl0IGlzIGdvb2QgdG8gc3BlY2lmeSB0aGUgY2xhc3MgZm9yIHZhcmlhYmxlcyBpZiB5b3Uga25vdyB0aGVtLiBXZSBrbm93IHRoYXQgd2Ugd2FudCB0aGUgdmFyaWFibGVzIGFib3V0IG1hbGUgYW5kIGZlbWFsZSBjb3VudHMgdG8gYmUgbnVtZXJpYy4gV2UgY2FuIHNwZWNpZnkgdGhhdCB1c2luZyB0aGUgYGNvbF90eXBlcyA9YCBhcmd1bWVudC4gU2VlIFtoZXJlXShodHRwczovL3JlYWRyLnRpZHl2ZXJzZS5vcmcvYXJ0aWNsZXMvcmVhZHIuaHRtbCkgYW5kIFtoZXJlXShodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvcmVhZHIvdmlnbmV0dGVzL3JlYWRyLmh0bWwpIGZvciBtb3JlIGluZm9ybWF0aW9uLgoKYGBge3J9CnBzX2RhdGEgPC0gcmVhZF9jc3YoImRvY3MvUG9saWNlX3N0YWZmaW5nL3BlXzE5NjBfMjAxOC5jc3YiKQpwc19kYXRhIDwtIHJlYWRfY3N2KCJkb2NzL1BvbGljZV9zdGFmZmluZy9wZV8xOTYwXzIwMTguY3N2IiwKICAgICAgICAgICAgICAgICAgICBjb2xfdHlwZXMgPSBjb2xzKG1hbGVfdG90YWxfY3QgPSAibiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmZW1hbGVfdG90YWxfY3QgPSAibiIpKQoKcHNfZGF0YSA8LSByZWFkX2NzdigiZG9jcy9Qb2xpY2Vfc3RhZmZpbmcvcGVfMTk2MF8yMDE4LmNzdiIsCiAgICAgICAgICAgICAgICAgICBjb2xfdHlwZXMgPSAgY29scyhtYWxlX3RvdGFsX2N0ID0gY29sX2RvdWJsZSgpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZlbWFsZV90b3RhbF9jdCA9IGNvbF9kb3VibGUoKSkpCmhlYWQocHNfZGF0YSkgICAgICAgICAgICAgICAgICAgICAgICAgICAgCmBgYAoKCgojIyBVbmVtcGx5bWVudCBkYXRhCgpUaGUgZm9sbG93aW5nIGRhdGEgd2FzIGRvd25sb2FkZWQgZnJvbSB0aGUgW1UuUy4gQnVyZWF1IG9mIExhYm9yIFN0YXRpc3RpY3NdKGh0dHBzOi8vZGF0YS5ibHMuZ292L2NnaS1iaW4vZHNydj9sYSkuIAoKVGhlcmUgYXJlIGV4Y2VsIGZpbGVzIGZvciBlYWNoIHN0YXRlLiAgQXMgeW91IGNhbiBzZWUsIHRoZXJlIGFyZSBtYW55IHJvd3MgdG8gc2tpcCB0byBtYWtlIHN1cmUgdGhhdCB0aGVyZSBhcmUgdGhlIHNhbWUgbnVtYmVyIG9mIGNvbHVtbnMgZm9yIGVhY2ggcm93LiBXZSBjYW4gYWxzbyBzZWUgdGhhdCB0aGUgc3RhdGUgbmFtZSBpcyBsb2NhdGVkIGluIGEgY291cGxlIG9mIHRoZSBmaXJzdCByb3dzLiAKCmBgYHtyfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAiVW5lbXAucG5nIikpCmBgYAoKV2UgY2FuIGFsc28gc2VlIHRoYXQgaGVyZSBpZiB3ZSBqdXN0IHRyeSB0byByZWFkIGluIHRoZSBmaWxlcyBkaXJlY3RseS4KCmBgYHtyfQoKdWVfcmF0ZV9kYXRhIDwtIGxpc3QuZmlsZXMocmVjdXJzaXZlID0gVFJVRSwKICAgICAgICAgICAgICAgICAgcGF0aCA9ICJkb2NzL1VuZW1wbG95bWVudCIsCiAgICAgICAgICAgICAgICAgIHBhdHRlcm4gPSAiKi54bHN4IiwKICAgICAgICAgICAgICAgICAgZnVsbC5uYW1lcyA9IFRSVUUpICU+JSAKICBtYXAofnJlYWRfeGxzeCguKSkKICAgICAgCmhlYWQodWVfcmF0ZV9kYXRhKVsxXQpgYGAKClNvIG5vdyB3ZSB3aWxsIHNraXAgdGhlIGZpcnN0IDEwIGxpbmVzLiBBbmQgYWxzbyBjcmVhdGUgYSBuYW1lcyB0aWJibGUgdGhhdCBjb250YWlucyBvbmx5IHRoZSBjZWxsIHdpdGggdGhlIHN0YXRlIGluZm9ybWF0aW9uLgoKYGBge3J9CiAKIHVlX3JhdGVfZGF0YSA8LSBsaXN0LmZpbGVzKHJlY3Vyc2l2ZSA9IFRSVUUsCiAgICAgICAgICAgICAgICAgIHBhdGggPSAiZG9jcy9VbmVtcGxveW1lbnQiLAogICAgICAgICAgICAgICAgICBwYXR0ZXJuID0gIioueGxzeCIsCiAgICAgICAgICAgICAgICAgIGZ1bGwubmFtZXMgPSBUUlVFKSAlPiUgCiAgbWFwKH5yZWFkX3hsc3goLiwgc2tpcCA9IDEwKSkKICAKaGVhZCh1ZV9yYXRlX2RhdGFbMV0pCmBgYAoKVG8gZ2V0IHRoZSBzdGF0ZSBuYW1lIGZvciBlYWNoIGZpbGUgdXNpbmcgdGhlIGBtYXAoKWAgZnVuY3Rpb24gdG8gcGVyZm9ybSBmdW5jdGlvbnMgYWNyb3NzIGFsbCBvZiB0aGUgZmlsZXMsIHdlIHdpbGwgc3BlY2lmaWNhbGx5IGltcG9ydCBvbmx5IGEgc21hbGwgcmFuZ2Ugb2YgY2VsbHMgdXNpbmcgdGhlIGByYW5nZSA9IGAgYXJndW1lbnQgYW5kIHRoZW4gZ3JhYiB0aGUgY2VsbCB0aGF0IGhhcyBzdGF0ZSBpbmZvcm1hdGlvbiBiYXNlZCBvbiBpdCdzIGxvY2F0aW9uIHdpdGhpbiB0aGUgcmFuZ2Ugb2YgY2VsbHMgaW1wb3J0ZWQgdXNpbmcgYGMoKWAgYW5kIHRoZW4gdXNlIHRoZSBiYXNlIGB1bmxpc3QoKWAgZnVuY3Rpb24gdG8gdW5saXN0IHRoZSBsaXN0IHRoYXQgdGhpcyBjcmVhdGVzLgoKYGBge3J9CnVlX3JhdGVfbmFtZXMgPC0gbGlzdC5maWxlcyhyZWN1cnNpdmUgPSBUUlVFLAogICAgICAgICAgICAgICAgICBwYXRoID0gImRvY3MvVW5lbXBsb3ltZW50IiwKICAgICAgICAgICAgICAgICAgcGF0dGVybiA9ICIqLnhsc3giLAogICAgICAgICAgICAgICAgICBmdWxsLm5hbWVzID0gVFJVRSkgJT4lCiAgbWFwKH5yZWFkX3hsc3goLiwgcmFuZ2UgPSAiQjQ6QjYiKSkgJT4lCiAgbWFwKC4sIGMoMSwyKSkgJT4lCiAgdW5saXN0KCkKCnVlX3JhdGVfbmFtZXMKYGBgCiMjIFBvdmVydHkgZGF0YQpFeHRyYWN0ZWQgZnJvbSBUYWJsZSAyMSBmcm9tIFtVUyBDZW5zdXMgQnVyZWF1IFBvdmVydHkgRGF0YSBdKGh0dHBzOi8vd3d3LmNlbnN1cy5nb3YvZGF0YS90YWJsZXMvdGltZS1zZXJpZXMvZGVtby9pbmNvbWUtcG92ZXJ0eS9oaXN0b3JpY2FsLXBvdmVydHktcGVvcGxlLmh0bWwpCgpBVk9DYWRvIHN0cmFuZ2UgaXNzdWUKCmBgYHtyfQoKIyoqcGVyc2lzdGVudCB3YXJuaW5nIGZyb20gdW5rbm93biBvcmlnaW4qKiBodHRwczovL2NvbW11bml0eS5yc3R1ZGlvLmNvbS90L3BlcnNpc3RlbnQtdW5rbm93bi1vci11bmluaXRpYWxpc2VkLWNvbHVtbi13YXJuaW5ncy82NDg3OQoKI3NvbHV0aW9uIHRvIGFib3ZlIGlzIGFsbGVkZ2VkbHk6ICJJbiBhbnkgY2FzZSB0aGUgc3VnZ2VzdGVkIGFwcHJvYWNoIGlzIHRvIGluaXRpYWxpemUgdGhlIGNvbHVtbiIKCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSByZWFkX3hscygiZG9jcy9Qb3ZlcnR5L2hzdHBvdjIxLnhscyIsIHNraXA9MikgI1RoaXMgbWF5IGNhdXNlIGluaXRpYWxpemF0aW9uIGlzc3VlLCBub3QgZWFzaWx5IHJlcHJvZHVjaWJsZSAoZXZlbiBhZnRlciByZXN0YXJ0aW5nIFIpCgpoZWFkKHBvdmVydHlfcmF0ZV9kYXRhKQpgYGAKCldlIGNhbiBzZWUgdGhhdCB0aGlzIHdpbGwgcmVxdWlyZSBzb21lIHdyYW5sZ2luZyB0byBtYWtlIHRoZSBkYXRhIG1vcmUgdXNhYmxlLiAKCiMjIFZpb2xlbnQgY3JpbWUKClZpb2xlbnQgY3JpbWUgZGF0YSB3YXMgb2J0YWluZWQgZnJvbSBbaGVyZV0oaHR0cHM6Ly93d3cudWNyZGF0YXRvb2wuZ292L1NlYXJjaC9DcmltZS9TdGF0ZS9TdGF0ZWJ5U3RhdGUuY2ZtKSBUaGlzIGRhdGEgaXMgYSBiaXQgdHJpY2tpZXIgYmVjYXVzZSBvZiBzcGFjZXMgYW5kIGAvYCBpbiB0aGUgY29sdW1uIG5hbWVzLCB0aHVzIHRoZSBgcmVhZF9saW5lcygpYCBmdW5jdGlvbiBvZiB0aGUgYHJlYWRyYCBwYWNrYWdlIHdvcmtzIGJldHRlciB0aGFuIHRoZSBgcmVhZF9jc3YoKWAgZnVuY3Rpb24uCgoKYGBge3J9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJjcmltZS5wbmciKSkKYGBgCgpgYGB7cn0KY3JpbWVfZGF0YSA8LSByZWFkX2xpbmVzKCJkb2NzL0NyaW1lL0NyaW1lU3RhdGVieVN0YXRlLmNzdiIsIHNraXAgPSAyLCBza2lwX2VtcHR5X3Jvd3MgPSBUUlVFKQpoZWFkKGNyaW1lX2RhdGEpCgpgYGAKCldlIGNhbiBzZWUgdGhhdCB0aGlzIGRhdGEgd2lsbCBhbHNvIHJlcXVpcmUgc29tZSB3cmFubGdpbmcgdG8gbWFrZSBpdCBtb3JlIHVzYWJsZS4gCgojIyBSaWdodC10by1jYXJyeSBkYXRhCgpUaGlzIGRhdGEgaXMgZXh0cmFjdGVkIGZyb20gdGFibGUgaW4gW0Rvbm9odWUgcGFwZXJdKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKS4gV2Ugd2lsbCB1c2UgdGhlIGZ1bmN0aW9uIGBwZGZfdGV4dCgpYCAgb2YgdGhlIGBwZGZ0b29sc2AgcGFja2FnZSB0byBpbXBvcnQgdGhlIHBkZiBkb2N1bWVudC4KCmBgYHtyfQoKaWYoIWZpbGUuZXhpc3RzKGhlcmUoImRvY3MiLCAidzIzNTEwLnBkZiIpKSl7CiAgdXJsIDwtICJodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZiIKICB1dGlsczo6ZG93bmxvYWQuZmlsZSh1cmwsIGhlcmUoImRvY3MiLCAidzIzNTEwLnBkZiIpKQp9CgpEQVdwYXBlciA8LSBwZGZfdGV4dChoZXJlKCJkb2NzIiwgIncyMzUxMC5wZGYiKSkKCmhlYWQoREFXcGFwZXJbMV0pCgpgYGAKCkFnYWluLCB0aGlzIGRhdGEgd2lsbCBhbHNvIHJlcXVpcmUgcXVpdGUgYSBiaXQgb2Ygd3JhbmdsaW5nLgoKCgojICoqRGF0YSBXcmFuZ2xpbmcqKgoqKioKIyMgU3RhdGUgRklQUyBjb2RlcwoKTGV0J3MgdGFrZSBhIGxvb2sgYXQgb3VyIHN0YXRlIEZJUFMgZGF0YSB0byBzZWUgaWYgaXQgbmVlZHMgYW55IGNsZWFuaW5nIG9yIHJlc2hhcGluZy4KCmBgYHtyfQpoZWFkKFNUQVRFX0ZJUFMpCmBgYAoKV2Ugb25seSBuZWVkIHRoZSBsYXN0IHR3byBjb2x1bW5zLCBidXQgd2UgbWlnaHQgd2FudCB0byByZW5hbWUgdGhlbS4gVGhlIGBOYW1lYCB2YXJpYWJsZSBpcyB2YWd1ZS4gVGhlIHZhcmlhYmxlIHdpdGggdGhlIEZJUFMgY29kZSBpcyBjYWxsZWQgYFN0YXRlXG4oRklQUylgLiBUbyBnZXQgcmlkIG9mIHRoZSBuZXcgbGluZSBpbiB0aGlzIHZhcmlhYmxlIG5hbWUgYW5kIHRvIGNoYW5nZSB0aGUgYE5hbWVgIHZhcmlhYmxlIHRvIHNvbWV0aGluZyBtb3JlIGluZm9ybWF0aXZlLCB3ZSB3aWxsIHVzZSB0aGUgYHJlbmFtZSgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlLiAgVG8gdXNlIHRoaXMgZnVuY3Rpb24sIHdlIG5lZWQgdG8gbGlzdCB0aGUgbmV3IG5hbWUgZmlyc3QgZm9sbG93ZWQgYnkgYD1gIGFuZCB0aGVuIHRoZSBleGlzdGluZyB2YXJpYWJsZS4gV2UgY2FuIHJlbmFtZSBtdWx0aXBsZSB2YXJpYWJsZXMgYXQgdGhlIHNhbWUgdGltZSBieSB1c2luZyBhIGNvbW1hIHRvIHNlcGFyYXRlIHRoZSB2YXJpYWJsZXMgd2UgYXJlIHJlbmFtaW5nLiBXZSB3aWxsIHVzZSB0aGUgYHNlbGVjdCgpYCBmdW5jdGlvbiBhbHNvIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UganVzdCB0byBrZWVwIHRoZXNlIHZhcmlhYmxlcywgYW5kIHdlIHdpbGwgZmlsdGVyIG91dCB0aGUgcm93cyB3aXRoIEZJUFMgdmFsdWVzIG9mIGAwMGAgd2l0aCB0aGUgYGZpbHRlcigpYCBmdW5jdGlvbiwgYWdpYW4gYWxzbyBwYXJ0IG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIHdlIHdpbGwgc3BlY2lmeSB0aGF0IHdlIHdhbnQgYFNUQVRFRlBgIHZhbHVlcyB0aGF0IGFyZSBub3QgZXF1YWwgdG8gYDAwYCBieSB1c2luZyB0aGlzIG9wZXJhdG9yOiBgIT1gLiBXZSB3aWxsIGFsc28gdXNlIHRoZSBkb3VibGUgcGlwZSBvcGVyYXRvciBgJTw+JWAgb2YgdGhlIGBtYWdyaXR0cmAgcGFja2FnZSB3aGljaCBhbGxvd3MgdXMgdG8gdXNlIGRhdGEgYXMgaXVwdXQgYW5kIHRoZW4gcmVhc3NpZ24gaXQgYWZ0ZXIgd2UgcGVmb3JtIHN1bSBmdW5jdGlvbnMgdXNpbmcgaXQuCgpgYGB7cn0KClNUQVRFX0ZJUFMgJTw+JSAKZHBseXI6OnJlbmFtZSggU1RBVEVGUCA9IGBTdGF0ZVxuKEZJUFMpYCwKICAgICAgICAgICAgICAgICBTVEFURSA9IE5hbWUpICU+JQogICAgZHBseXI6OnNlbGVjdChTVEFURUZQLCBTVEFURSkgJT4lCiAgICBkcGx5cjo6ZmlsdGVyKFNUQVRFRlAgIT0gIjAwIikKClNUQVRFX0ZJUFMKCmBgYAoKIyMgRGVtb2dyYXBoaWNzCgojIyMjIDE5NzctMTk3OQoKTm93IGxldCdzIHRha2UgYSBsb29rIGF0IG91ciBkZW1vZ3JhcGhpYyBkYXRhIGFjcm9zcyB0aGUgZGVjYWRlcyB0aGF0IHdlIHdpc2ggdG8gc3R1ZHkuIElmIHlvdSBoYXZlIHZlcnkgd2lkZSBkYXRhIChtZWFuaW5nIGl0IGhhcyBtYW55IGNvbHVtbnMpLCBvbmUgd2F5IHRvIHZpZXcgdGhlIGRhdGEgc28gdGhhdCB5b3UgY2FuIHNlZSBhbGwgb2YgdGhlIGNvbHVtbnMgYXQgdGhlIHNhbWUgdGltZSBpcyB0byB1c2UgdGhlIGBnbGltcHNlKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIAoKVGFraW5nIGEgbG9vayBhdCB0aGUgZmlyc3QgZGVjYWRlIG9mIGRhdGEsIHdlIGNhbiBzZWUgdGhhdCB0aGUgYFJhY2UvU2V4IEluZGljYXRvcmAgY29udGFpbnMgdHdvIHR5cGVzIG9mIGRhdGEsIHRoZSByYWNlIGFuZCB0aGUgc2V4LiBUaGlzIGRvZXMgbm90IGZvbGxvdyB0aGUgdGlkeSBkYXRhIHBoaWxvc29waHksIHdoZXJlIGVhY2ggY2VsbCBvZiBhIHRpYmJsZSBzaG91bGQgb25seSBjb250YWluIG9uZSBwaWVjZSBvZiBpbmZvcm1hdGlvbi4gVHlwaWNhbGx5IG9uZSBtaWdodCB0aGluayBvZiB1c2luZyB0aGUgYHNlcGFyYXRlKClgIGZ1bmN0aW9uIG9mIHRoZSBgdGlkeXJgIHBhY2thZ2UgdG8gc3BsaXQgdGhpcyB2YXJpYWJsZSBpbnRvIHR3by4gSG93ZXZlciwgb25lIG9mIHRoZSByYWNlIHZhbHVlcyBpcyBgT3RoZXIgcmFjZXNgIGFuZCBzaW5jZSB0aGlzIGFsc28gaGFzIGEgc3BhY2UsIHRoaXMgbWFrZXMgc2VwYXJhdGluZyB0aGlzIGRhdGEgbW9yZSB0cmlja3kuCgpJbnN0ZWFkIHdlIHdpbGwgdXNlIHRoZSBgc3RyX2V4dHJhY3QoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdHJpbmdyYCBwYWNrYWdlIGFuZCB0aGUgYG11dGF0ZSgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlLiBUaGUgIm11dGF0ZSgpIiB3aWxsIGFsbG93IHVzIHRvIGNyZWF0ZSBuZXcgdmFyaWFibGVzLCBhbmQgInN0cl9leHRyYWN0KCkiIGZ1bmN0aW9uICB3aWxsIGFsbG93IHVzIHRvIG1hdGNoIHNwZWNpZmljIHBhdHRlcm5zIGFuZCBwdWxsIG91dCBtYXRjaGVzIHRvIHRob3NlIHBhdHRlcm5zLiBUaGVyZWZvcmUsIGlmIHRoZSBgUmFjZS9TZXggSW5kaWNhdG9yYCB2YWx1ZSBpcyBgT3RoZXIgcmFjZXMgbWFsZWAgYW5kIGlmIHdlIGV4dHJhY3QgcGF0dGVybnMgbWF0Y2hpbmcgZWl0aGVyIGAibWFsZSJgIG9yIGAiZmVtYWxlImAgd2hpY2ggd2UgY2FuIHNwZWNpZnkgbGlrZSB0aGlzIGBwYXR0ZXJuID0gIm1hbGV8ZmVtYWxlImAgdGhlbiwgdGhlIHZhbHVlIHdpbGwgYmUgYG1hbGVgLgoKRmlyc3Qgd2UgbmVlZCB0byByZW5hbWUgdGhlIGBSYWNlL1NleCBJbmRpY2F0b3JgIHZhcmFpYmxlIHRvIG5vdCBoYXZlIHNwYWNlcyBzbyB0aGF0IGl0IGlzIGNvbXBhdGlibGUgd2l0aCB0aGUgYHN0cl9leHRyYWN0KClgIGZ1bmN0aW9uLgoKV2UgYWxzbyB3YW50IHRvIHJlbmFtZSBhIGNvdXBsZSBvZiB2YXJpYWJsZXMgdG8gYmUgc2ltcGxlciBhbmQgZmlsdGVyIHRoZSBkYXRhIHRvIG9ubHkgaW5jbHVkZSB0aGUgeWVhcnMgb2YgdGhlIGRhdGEgd2UgYXJlIGludGVyZXN0ZWQgaW4sIGFzIHdlbGwgYXMgcmVtb3ZlIHNvbWUgdmFyaWFibGVzIHRoYXQgd2UgZG9udCBuZWVkIGxpa2UgdGhlIGBGSVBTIFN0YXRlIENvZGVgLiBXZSBjYW4gcmVtb3ZlIHZhcmlhYmxlcyBieSB1c2luZyB0aGUgYHNlbGVjdCgpYCBmdW5jdGlvbiB3aXRoIGEgYC1gIG1pbnVzIHNpZ24gaW4gZnJvbnQgb2YgdGhlIHZhcmlhYmxlIHdlIHdpc2ggdG8gcmVtb3ZlLgoKYGBge3J9CmRwbHlyOjpnbGltcHNlKGRlbV83N183OSkKCgpkZW1fNzdfNzkgPC0gZGVtXzc3Xzc5ICU+JQogIHJlbmFtZSgicmFjZV9zZXgiID1gUmFjZS9TZXggSW5kaWNhdG9yYCkgJT4lCiAgbXV0YXRlKFNFWCA9IHN0cl9leHRyYWN0KHJhY2Vfc2V4LCAibWFsZXxmZW1hbGUiKSwKICAgICAgICBSQUNFID0gc3RyX2V4dHJhY3QocmFjZV9zZXgsICJCbGFja3xXaGl0ZXxPdGhlciIpKSU+JQogIHNlbGVjdCgtYEZJUFMgU3RhdGUgQ29kZWAsIC1gcmFjZV9zZXhgKSAlPiUKICByZW5hbWUoIllFQVIiID0gYFllYXIgb2YgRXN0aW1hdGVgLAogICAgICAgICJTVEFURSIgPSBgU3RhdGUgTmFtZWApICU+JQogIGZpbHRlcihZRUFSICVpbiUgMTk3NzoxOTc5KQoKZ2xpbXBzZShkZW1fNzdfNzkpCmBgYAoKVGhhdCdzIGxvb2tpbmcgcHJldHR5ICBnb29kISBXZSBhbHNvIHdhbnQgdG8gdGFrZSBhbGwgdGhlIGFnZSBncm91cCB2YXJpYWJlbHMgYW5kIG1ha2Ugb25lIHZhcmlhYmxlIHRoYXQgaXMgdGhlIGFnZSBncm91cCBuYW1lIGFuZCBvbmUgdGhhdCBpcyB0aGUgdmFsdWUgb2YgdGhlIHBvcHVsYXRpb24gY291bnQgZm9yIHRoYXQgYWdlIGdyb3VwLiBUbyBkbyB0aGlzIHdlIHdpbGwgdXNlIHRoZSBgcGl2b3RfbG9uZ2VyKClgIGZ1bmN0aW9uIG9mIHRoZSBgdGlkeXJgIHBhY2thZ2UuIFRvIHVzZSB0aGlzIGZ1bmN0aW9uLCB3ZSBuZWVkIHRvIHVzZSB0aGUgYGNvbHNgIGFyZ3VtZW50IHRvIGluZGljYXRlIHdoaWNoIGNvbHVtbnMgd2Ugd2FudCB0byBwaXZvdC4gV2UgYWxzbyBuYW1lIHRoZSBuZXcgdmFyaWFibGVzIHdlIHdpbGwgY3JlYXRlIHdpdGggdGhlIGBuYW1lc190b2AgYW5kIGB2YWx1ZXNfdG9gIGFyZ3VtZW50cy4gVGhlIGBuYW1lc190b2Agd2lsbCBiZSB0aGUgbmFtZSBvZiB0aGUgdmFyaWFibGUgdGhhdCB3aWxsIGlkZW50aWZ5IGVhY2ggYWdlIGdyb3VwIGFuZCBgdmFsdWVzX3RvYCB3aWxsIGJlIHRoZSBuYW1lIG9mIHRoZSB2YXJpYWJsZSB0aGF0IGNvbnRhaW5zIHRoZSBjb3JyZXNwb25kaW5nIHBvcHVsYXRpb24gdmFsdWVzLgpgYGB7cn0KZGVtXzc3Xzc5IDwtIGRlbV83N183OSAlPiUKICBwaXZvdF9sb25nZXIoY29scz1jb250YWlucygieWVhcnMiKSwKICAgICAgICAgICAgICAgbmFtZXNfdG8gPSAiQUdFX0dST1VQIiwKICAgICAgICAgICAgICAgdmFsdWVzX3RvID0gIlNVQl9QT1AiKQoKZ2xpbXBzZShkZW1fNzdfNzkpCmBgYAoKV2UgYWxzbyB3YW50IHRvIGdldCBkYXRhIGFib3V0IHRoZSB0b3RhbCBwb3B1bGF0aW9uIGZvciB0aGUgc3RhdGUgZm9yIGVhY2ggeWVhci4KClRvIGRvIHNvIHdlIGNhbiBzdW0gYWxsIHRoZSB2YWx1ZXMgZm9yIHRoZSBgU1VCX1BPUGAgdmFyaWFibGUgdGhhdCB3ZSBqdXN0IGNyZWF0ZWQuIFRvIGRvIHRoaXMgd2UgY2FuIHVzZSB0aGUgYGdyb3VwX2J5YCBhbmQgYHN1bW1hcml6ZSgpYCBmdW5jdGlvbnMgb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gVGhlIGBncm91cF9ieSgpYCBmdW5jdGlvbiBzcGVjaWZpZXMgaG93IHdlIHdhbnQgdG8gY2FsY3VsYXRlICBvdXIgc3VtLCB0aGF0IHdlIHdvdWxkIGxpa2UgdG8gY2FsY3VsYXRlIGl0IGZvciBlYWNoIHllYXIgYW5kIGVhY2ggc3RhdGUgaW5kaXZpZHVhbGx5LiBUaHVzLCBhbGwgdGhlIHZhbHVlcyB0aGF0IGhhdmUgdGhlIHNhbWUgYFNUQVRFYCBhbmQgYFlFQVJgIHZhbHVlcyB3aWxsIGJlIHN1bW1lZCB0b2dldGhlciwgcmF0aGVyIHRoYW4gc3VtbWluZyB1c2luZyBhbGwgb2YgdGhlIHZhbHVlcyBpbiB0aGUgYFNVQl9QT1BgIHZhcmlhYmxlLiBUaGUgYC5ncm91cHNgIGFyZ3VtZW50IGFsbG93cyB1cyB0byByZW1vdmUgdGhlIGdyb3VwaW5nIGFmdGVyIHdlIHBlZm9ybSB0aGUgY2FsY3VsYXRpb24gd2l0aCBgc3VtbWFyaXplKClgLgoKYGBge3J9CnBvcF83N183OSA8LSBkZW1fNzdfNzkgJT4lCiAgZ3JvdXBfYnkoWUVBUiwgU1RBVEUpICU+JQogIHN1bW1hcml6ZSgiVE9UX1BPUCIgPSBzdW0oU1VCX1BPUCksIC5ncm91cHMgPSAiZHJvcCIpIAoKcG9wXzc3Xzc5IApgYGAKCgogTm93IHdlIHdpbGwgYWRkIHRoZSBwb3B1bGF0aW9uIHZhbHVlIHRvIHRoZSBkZW1vZ3JhcGhpYyB0aWJibGUgdXNpbmcgdGhlIGBsZWZ0X2pvaW4oKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gSXQgaXMgaW1wb3JhbnQgdGhhdCB3ZSBzcGVjaWZ5IGhvdyB0aGlzIHNob3VsZCBiZSBkb25lLCB0aGF0IHRoZSBgWUVBUmAgYW5kIGBTVEFURWAgdmFyaWFibGUgdmxhdWVzIHNob3VsZCBtYXRjaCBlYWNob3RoZXIuIFRoaXMgd2lsbCBwbGFjZSB0aGUgYGRlbV83N183OWAgdmFyaWFibGVzIHRvIHRoZSBsZWZ0IG9mIHRoZSBgcG9wXzc3Xzc5YCBkYXRhLiAKIApgYGB7cn0KZGVtXzc3Xzc5IDwtIGRlbV83N183OSAlPiUKICBsZWZ0X2pvaW4ocG9wXzc3Xzc5LCBieSA9IGMoIllFQVIiLCJTVEFURSIpKQoKZGVtXzc3Xzc5CmBgYAoKV2Ugd2lsbCBhbHNvIGNhbGN1bGF0ZSB0aGUgcGVyY2VudGFnZSB0aGF0IGVhY2ggZ3JvdXAgbWFrZXMgdXAgb2YgdGhlIHRvdGFsIHBvcHVsYXRpb24sIGJ5IGRpdmlkaW5nIHRoZSBgU1VCX1BPUGAgYnkgdGhlIGBUT1RfUE9QYCBhbmQgbXVsdGlwbHlpbmcgYnkgMTAwIHVzaW5nIHRoZSBgbXV0YXRlKClgIGZ1bmN0aW9uLiB3ZSB3aWxsIGFsc28gcmVtb3ZlIHRoZSBvdGhlciBwb3B1bGF0aW9uIHZhcmlhYmxlcy4KCmBgYHtyfQpkZW1fNzdfNzkgPC0gZGVtXzc3Xzc5ICU+JQogIG11dGF0ZShQRVJDX1NVQl9QT1AgPSAoU1VCX1BPUC9UT1RfUE9QKSoxMDApICU+JQogIHNlbGVjdCgtU1VCX1BPUCwgLVRPVF9QT1ApCgpkZW1fNzdfNzkKYGBgCgoKIyMjIyAxOTgwLTE5ODkKCkZvciB0aGlzIGRlY2FkZSBlYWNoIHllYXIgaXMgYSBzZXBhcmF0ZSB0aWJibGUgYW5kIHRoZXkgYXJlIGNvbWJpbmVkIGFzIGEgbGlzdC4KYGBge3J9CmNsYXNzKGRlbV84MF84OSkKYGBgCgpTbyB0aGUgZmlyc3QgdGhpbmcgd2UgbmVlZCB0byBkbyBpcyBjb21iaW5lIGVhY2ggdGliYmxlIG9mIHRoZSBsaXN0IHRvZ2V0aGVyLiBXZSBjYW4gZG8gdGhhdCB1c2luZyB0aGUgYGJpbmRfcm93cygpYCBmdW5jdGlvbiBvZiBgZHBseXJgIHdoaWNoIGFwcGVuZHMgdGhlIGRhdGEgdG9nZXRoZXIgYmFzZWQgb24gdGhlIHByZXNlbmNlIG9mIGNvbHVtbnMgd2l0aCB0aGUgc2FtZSBuYW1lIGluIHRoZSBkaWZmZXJlbnQgdGliYmxlcy4gV2Ugd2lsbCB1c2UgdGhlIGBtYXBfZGYoKWAgZnVuY3Rpb24gb2YgdGhlIGBwdXJycmAgcGFja2FnZSB0byBhbGxvdyB1cyB0byBkbyB0aGlzIGFjcm9zcyBlYWNoIHRpYmJsZSBpbiBvdXIgbGlzdC4gCmBgYHtyfQpkZW1fODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIG1hcF9kZihiaW5kX3Jvd3MpCgpnbGltcHNlKGRlbV84MF84OSApCmBgYAoKR3JlYXQhIE5vdyBvdXIgZGF0YSBpcyBhbGwgdG9nZXRoZXIuCgpOb3cgd2Ugd2lsbCB3cmFuZ2xlIHRoZSBkYXRhIHNpbWlsYXJseSB0byB0aGUgcHJldmlvdXMgZGVjYWRlLgpgYGB7cn0KZGVtXzgwXzg5IDwtIGRlbV84MF84OSAlPiUKICByZW5hbWUoInJhY2Vfc2V4IiA9YFJhY2UvU2V4IEluZGljYXRvcmApICU+JQogIG11dGF0ZShTRVggPSBzdHJfZXh0cmFjdChyYWNlX3NleCwgIm1hbGV8ZmVtYWxlIiksCiAgICAgICAgUkFDRSA9IHN0cl9leHRyYWN0KHJhY2Vfc2V4LCAiQmxhY2t8V2hpdGV8T3RoZXIiKSklPiUKICBzZWxlY3QoIC1gcmFjZV9zZXhgKSAlPiUKICByZW5hbWUoIllFQVIiID0gYFllYXIgb2YgRXN0aW1hdGVgKQogICAgICAgICAKZ2xpbXBzZShkZW1fODBfODkpCmBgYApOb3RpY2UgdGhhdCB0aGlzIHRpbWUgdGhlIHN0YXRlIGluZm9ybWF0aW9uIGlzIGJhc2VkIG9uIHRoZSBudW1lcmljIEZJUFMgdmFsdWUuIFdlIHdhbnQgb25seSB0aGUgZmlyc3QgdHdvIHZhbHVlcywgYXMgdGhlIHJlc3QgaW5kaWNhdGUgdGhlIGNvdW50eS4gV2UgY2FuIHVzZSB0aGUgYHN0cl9zdWIoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdHJpbmdyYCBwYWNrYWdlIGZvciB0aGlzLiBXZSB3aWxsIHNwZWNpZnkgdGhhdCB3ZSB3YW50IHRvIHN0YXJ0IGF0IHRoZSBmaXJzdCBwb3NpdGlvbiBhbmQgZW5kIGF0IHRoZSBzZWNvbmQuICBKdXN0IGxpa2UgYHN0cl9leHRyYWN0KClgIHdlIG5lZWQgdG8gcmVuYW1lIHRoaXMgdmFyaWFibGUgZmlyc3Qgc28gdGhhdCBpdCBpcyBjb21wYXRpYmxlLiAKYGBge3J9CmRlbV84MF84OSAlPD4lCnJlbmFtZSgiU1RBVEVGUF90ZW1wIiA9ICJGSVBTIFN0YXRlIGFuZCBDb3VudHkgQ29kZXMiKSAlPiUKbXV0YXRlKFNUQVRFRlAgPSBzdHJfc3ViKFNUQVRFRlBfdGVtcCwgc3RhcnQgPSAxLCBlbmQgPSAyKSkgJT4lCiAgICBsZWZ0X2pvaW4oU1RBVEVfRklQUywgYnkgPSAiU1RBVEVGUCIpICU+JQogIGRwbHlyOjpzZWxlY3QoLVNUQVRFRlApCgpnbGltcHNlKGRlbV84MF84OSkKYGBgCgpBVk9DQURPIC0gd2h5IGRvIHdlIGdyb3VwIGJ5IGFnZV9ncm91cCBzZXggYW5kIHJhY2UgdGhpcyB0aW1lIGJ1dCBub3Qgd2l0aCB0aGUgbGFzdCBkZWNhZGU/CgpgYGB7cn0KZGVtXzgwXzg5ICU8PiUKICBwaXZvdF9sb25nZXIoY29scz1jb250YWlucygieWVhcnMiKSwKICAgICAgICAgICAgICAgbmFtZXNfdG8gPSAiQUdFX0dST1VQIiwKICAgICAgICAgICAgICAgdmFsdWVzX3RvID0gIlNVQl9QT1BfdGVtcCIpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFLCBBR0VfR1JPVVAsIFNFWCwgUkFDRSkgJT4lCiAgc3VtbWFyaXNlKFNVQl9QT1AgPSBzdW0oU1VCX1BPUF90ZW1wKSwgLmdyb3Vwcz0iZHJvcCIpCgpkZW1fODBfODkKYGBgCiAgCmBgYHtyfQpwb3BfODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBzdW1tYXJpc2UoIlRPVF9QT1AiID0gc3VtKFNVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAKCgpkZW1fODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIGxlZnRfam9pbihwb3BfODBfODksIGJ5ID0gYygiWUVBUiIsIlNUQVRFIikpICU+JQogIG11dGF0ZShQRVJDX1NVQl9QT1AgPSAoU1VCX1BPUC9UT1RfUE9QKSoxMDApICU+JQogIGRwbHlyOjpzZWxlY3QoLVNVQl9QT1AsIC1UT1RfUE9QKQoKZGVtXzgwXzg5CmBgYAoKIyMjIyAxOTkwLTE5OTkKCgpgYGB7cn0KZ2xpbXBzZShkZW1fOTBfOTkpCgpjb2xuYW1lcyhkZW1fOTBfOTkpIDwtIGMoIllFQVIiLAogICAgICAgICAgICAgICAgICAgICAgICAgIlNUQVRFRlAiLAogICAgICAgICAgICAgICAgICAgICAgICAgIkFnZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiTkhfV19NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJOSF9XX0YiLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX0JfTSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiTkhfQl9GIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJOSF9BSUFOX00iLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX0FJQU5fRiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiTkhfQVBJX00iLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX0FQSV9GIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX1dfTSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9XX0YiLAogICAgICAgICAgICAgICAgICAgICAgICAgIkhfQl9NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX0JfRiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9BSUFOX00iLAogICAgICAgICAgICAgICAgICAgICAgICAgIkhfQUlBTl9GIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX0FQSV9NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX0FQSV9GIikKCmRpbShkZW1fOTBfOTkpCgpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogICAgbXV0YXRlKFdfTSA9IE5IX1dfTSArIEhfV19NLAogICAgICAgICAgIFdfRiA9IE5IX1dfRiArIEhfV19GLAogICAgICAgICAgIEJfTSA9IE5IX0JfTSArIEhfQl9NLAogICAgICAgICAgIEJfRiA9IE5IX0JfRiArIEhfQl9GLAogICAgICAgICAgIEFJQU5fTSA9IE5IX0FJQU5fTSArIEhfQUlBTl9NLAogICAgICAgICAgIEFJQU5fRiA9IE5IX0FJQU5fRiArIEhfQUlBTl9GLAogICAgICAgICAgIEFQSV9NID0gTkhfQVBJX00gKyBIX0FQSV9NLAogICAgICAgICAgIEFQSV9GID0gTkhfQVBJX0YgKyBIX0FQSV9GLAogICAgICAgICAgIG5fbmEgPSByb3dTdW1zKGlzLm5hKC4pKSkgJT4lCiAgZHBseXI6OnNlbGVjdCgtc3RhcnRzX3dpdGgoIk5IXyIpLCAtc3RhcnRzX3dpdGgoIkhfIikpCgpkZW1fOTBfOTkgJT4lCiAgZ3JvdXBfYnkobl9uYSkgJT4lCiAgdGFsbHkoKQoKZW1wdHlfcm93c19uYSA8LSBkZW1fOTBfOTkgJT4lCiAgZ3JvdXBfYnkobl9uYSkgJT4lCiAgdGFsbHkoKSAlPiUKICBmaWx0ZXIobl9uYSAhPSAwKSAlPiUKICBwdWxsKG5fbmEpCgpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIGZpbHRlcihuX25hICE9IGVtcHR5X3Jvd3NfbmEpICU+JQogIGRwbHlyOjpzZWxlY3QoLW5fbmEpCgpzYXBwbHkoZGVtXzkwXzk5LCBjbGFzcykKCnN1bW1hcnkoYXMuZmFjdG9yKGRlbV84MF84OSRBR0VfR1JPVVApKQoKZGVtXzkwXzk5IDwtIGRlbV85MF85OSAlPiUKICBtdXRhdGUoQUdFX0dST1VQID0gY3V0KEFnZSwKICAgICAgICAgICAgICAgICAgICAgICAgIGJyZWFrcyA9IHNlcSgwLDkwLCBieT01KSwKICAgICAgICAgICAgICAgICAgICAgICAgIHJpZ2h0ID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBjKCJVbmRlciA1IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjUgdG8gOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIxMCB0byAxNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIxNSB0byAxOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIyMCB0byAyNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIyNSB0byAyOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzMCB0byAzNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzNSB0byAzOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI0MCB0byA0NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI0NSB0byA0OSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI1MCB0byA1NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI1NSB0byA1OSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI2MCB0byA2NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI2NSB0byA2OSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI3MCB0byA3NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI3NSB0byA3OSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI4MCB0byA4NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI4NSB5ZWFycyBhbmQgb3ZlciIpCiAgICAgICAgICAgICAgICAgICAgICAgICApKSAlPiUKICBkcGx5cjo6c2VsZWN0KC1BZ2UpICU+JQogIG11dGF0ZShBR0VfR1JPVVAgPSBhcy5jaGFyYWN0ZXIoQUdFX0dST1VQKSkKCnNhcHBseShkZW1fOTBfOTksIGNsYXNzKQoKZGVtXzkwXzk5IDwtIGRlbV85MF85OSAlPiUKICBncm91cF9ieShZRUFSLCBTVEFURUZQLCBBR0VfR1JPVVApICU+JQogIHN1bW1hcmlzZV9hdCh2YXJzKHN0YXJ0c193aXRoKCJXXyIpLAogICAgICAgICAgICAgICAgICAgIHN0YXJ0c193aXRoKCJCXyIpLAogICAgICAgICAgICAgICAgICAgIHN0YXJ0c193aXRoKCJBSUFOXyIpLAogICAgICAgICAgICAgICAgICAgIHN0YXJ0c193aXRoKCJBUElfIikpLCBzdW0pICU+JQogIHVuZ3JvdXAoKSAlPiUKICBwaXZvdF9sb25nZXIoY29scyA9IGMoc3RhcnRzX3dpdGgoIldfIiksCiAgICAgICAgICAgICAgICAgICAgc3RhcnRzX3dpdGgoIkJfIiksCiAgICAgICAgICAgICAgICAgICAgc3RhcnRzX3dpdGgoIkFJQU5fIiksCiAgICAgICAgICAgICAgICAgICAgc3RhcnRzX3dpdGgoIkFQSV8iKSksCiAgICAgICAgICAgICAgIG5hbWVzX3RvID0gIlJBQ0UiLAogICAgICAgICAgICAgICB2YWx1ZXNfdG8gPSAiU1VCX1BPUCIpCgpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIG11dGF0ZShTRVggPSBjYXNlX3doZW4oc3RyX2RldGVjdChSQUNFLCAiX00iKSB+ICJNYWxlIiwKICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiAiRmVtYWxlIiksCiAgICAgICAgIFJBQ0UgPSBjYXNlX3doZW4oc3RyX2RldGVjdChSQUNFLCAiV18iKSB+ICJXaGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgc3RyX2RldGVjdChSQUNFLCAiQl8iKSB+ICJCbGFjayIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+ICJPdGhlciIpKSAlPiUKICBsZWZ0X2pvaW4oU1RBVEVfRklQUywgYnkgPSAiU1RBVEVGUCIpICU+JQogIGRwbHlyOjpzZWxlY3QoLVNUQVRFRlApCgpwb3BfOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBzdW1tYXJpc2UoVE9UX1BPUCA9IHN1bShTVUJfUE9QKSwgLmdyb3VwcyA9ICJkcm9wIikKCmRlbV85MF85OSA8LSBkZW1fOTBfOTkgJT4lCiAgbGVmdF9qb2luKHBvcF85MF85OSwgYnk9YygiWUVBUiIsICJTVEFURSIpKSAlPiUKICBtdXRhdGUoUEVSQ19TVUJfUE9QID0gU1VCX1BPUCoxMDAvVE9UX1BPUCkgJT4lCiAgZHBseXI6OnNlbGVjdCgtU1VCX1BPUCwgLVRPVF9QT1ApCmBgYAoKIyMjIyAyMDAwLTIwMTAKCmBgYHtyfQpkZW1fMDBfMTAgPC0gZGVtXzAwXzEwICU+JQogIG1hcF9kZihiaW5kX3Jvd3MpCgpnbGltcHNlKGRlbV8wMF8xMCkKCmRlbV8wMF8xMCA8LSBkZW1fMDBfMTAgJT4lCiAgZHBseXI6OnNlbGVjdCgtRVNUSU1BVEVTQkFTRTIwMDAsLUNFTlNVUzIwMTBQT1ApICU+JQogIGZpbHRlcihSRUdJT04gIT0gMCwKICAgICAgICAgRElWSVNJT04gIT0gMCwKICAgICAgICAgU0VYICE9IDAsCiAgICAgICAgIE9SSUdJTiA9PSAwLAogICAgICAgICBSQUNFICE9IDAsCiAgICAgICAgIEFHRUdSUCAhPSAwLAogICAgICAgICBTVEFURSAhPSAwKSAlPiUKICBkcGx5cjo6c2VsZWN0KC1SRUdJT04sIC1ESVZJU0lPTiwgLU9SSUdJTiwgLVNUQVRFKSAlPiUKICByZW5hbWUoIlNUQVRFIiA9IE5BTUUsCiAgICAgICAgICJBR0VfR1JPVVAiID0gQUdFR1JQKSAlPiUKICBtdXRhdGUoU0VYID0gZmFjdG9yKFNFWCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxldmVscyA9IDE6MiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IGMoIk1hbGUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiRmVtYWxlIikpLAogICAgICAgICBSQUNFID0gZmFjdG9yKFJBQ0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHMgPSAxOjYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBjKCJXaGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJCbGFjayIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHJlcCgiT3RoZXIiLDQpKSksCiAgICAgICAgIEFHRV9HUk9VUCA9IGZhY3RvcihBR0VfR1JPVVAsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHMgPSAxOjE4LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbGFiZWxzID0gYygiVW5kZXIgNSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI1IHRvIDkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMTAgdG8gMTQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMTUgdG8gMTkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMjAgdG8gMjQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMjUgdG8gMjkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMzAgdG8gMzQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMzUgdG8gMzkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNDAgdG8gNDQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNDUgdG8gNDkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNTAgdG8gNTQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNTUgdG8gNTkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNjAgdG8gNjQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNjUgdG8gNjkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNzAgdG8gNzQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNzUgdG8gNzkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiODAgdG8gODQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiODUgeWVhcnMgYW5kIG92ZXIiKSkpICU+JQogIG11dGF0ZShTRVggPSBhcy5jaGFyYWN0ZXIoU0VYKSwKICAgICAgICAgUkFDRSA9IGFzLmNoYXJhY3RlcihSQUNFKSwKICAgICAgICAgQUdFX0dST1VQID0gYXMuY2hhcmFjdGVyKEFHRV9HUk9VUCkpCiAgCmNvbG5hbWVzKGRlbV8wMF8xMCkKCmRlbV8wMF8xMCA8LSBkZW1fMDBfMTAgJT4lCiAgcGl2b3RfbG9uZ2VyKGNvbHM9Y29udGFpbnMoIkVTVElNQVRFIiksCiAgICAgICAgICAgICAgIG5hbWVzX3RvID0gIllFQVIiLAogICAgICAgICAgICAgICB2YWx1ZXNfdG8gPSAiU1VCX1BPUCIpCgpkZW1fMDBfMTAgPC0gZGVtXzAwXzEwICU+JQogIG11dGF0ZShZRUFSID0gc3RyX3N1YihZRUFSLCBzdGFydD0tNCkpICU+JQogIG11dGF0ZShZRUFSID0gYXMubnVtZXJpYyhZRUFSKSkKCnNhcHBseShkZW1fMDBfMTAsIGNsYXNzKQoKcG9wXzAwXzEwIDwtIGRlbV8wMF8xMCAlPiUKICBncm91cF9ieShZRUFSLCBTVEFURSkgJT4lCiAgc3VtbWFyaXNlKFRPVF9QT1AgPSBzdW0oU1VCX1BPUCksIC5ncm91cHMgPSAiZHJvcCIpCgpkZW1fMDBfMTAgJT4lCiAgbGVmdF9qb2luKHBvcF8wMF8xMCwgYnk9YygiWUVBUiIsICJTVEFURSIpKSAlPiUKICBncm91cF9ieShZRUFSLCBTVEFURSkgJT4lCiAgbXV0YXRlKFBFUkNfU1VCX1BPUCA9IFNVQl9QT1AqMTAwL1RPVF9QT1ApICU+JQogIHN1bW1hcmlzZShwZXJjX3RvdCA9IHN1bShQRVJDX1NVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAlPiUKICBtdXRhdGUocG9zc19lcnJvciA9IGNhc2Vfd2hlbihhYnMocGVyY190b3QgLSAxMDApID4gMCB+IFRSVUUsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiBGQUxTRSkpICU+JQogIGdyb3VwX2J5KHBvc3NfZXJyb3IpICU+JQogIHRhbGx5KCkKCmRlbV8wMF8xMCA8LSBkZW1fMDBfMTAgJT4lCiAgbGVmdF9qb2luKHBvcF8wMF8xMCwgYnk9YygiWUVBUiIsICJTVEFURSIpKSAlPiUKICBtdXRhdGUoUEVSQ19TVUJfUE9QID0gU1VCX1BPUCoxMDAvVE9UX1BPUCkgJT4lCiAgZHBseXI6OnNlbGVjdCgtU1VCX1BPUCwgLVRPVF9QT1ApCmBgYAoKCgoKIyMjIENvbWJpbmluZyBkZW1vZ3JhcGhpYyBkYXRhCgpgYGB7cn0Kc2V0ZXF1YWwoY29sbmFtZXMoZGVtXzc3Xzc5KSxjb2xuYW1lcyhkZW1fODBfODkpKQpzZXRlcXVhbChjb2xuYW1lcyhkZW1fODBfODkpLGNvbG5hbWVzKGRlbV85MF85OSkpCnNldGVxdWFsKGNvbG5hbWVzKGRlbV85MF85OSksY29sbmFtZXMoZGVtXzAwXzEwKSkKCmhlYWQoZGVtXzc3Xzc5KQpoZWFkKGRlbV84MF84OSkKaGVhZChkZW1fOTBfOTkpCmhlYWQoZGVtXzAwXzEwKQoKbGVuZ3RoKHN1bW1hcnkoYXMuZmFjdG9yKGRlbV83N183OSRBR0VfR1JPVVApKSkKbGVuZ3RoKHN1bW1hcnkoYXMuZmFjdG9yKGRlbV84MF84OSRBR0VfR1JPVVApKSkKbGVuZ3RoKHN1bW1hcnkoYXMuZmFjdG9yKGRlbV85MF85OSRBR0VfR1JPVVApKSkKbGVuZ3RoKHN1bW1hcnkoYXMuZmFjdG9yKGRlbV8wMF8xMCRBR0VfR1JPVVApKSkKCmRlbSA8LSBiaW5kX3Jvd3MoZGVtXzc3Xzc5LAogICAgICAgICAgICAgICAgIGRlbV84MF84OSwKICAgICAgICAgICAgICAgICBkZW1fOTBfOTksCiAgICAgICAgICAgICAgICAgZGVtXzAwXzEwKQogIApkZW0gJT4lCiAgZmlsdGVyKFJBQ0UgPT0gIk90aGVyIikgJT4lCiAgZ3JvdXBfYnkoWUVBUikgJT4lCiAgdGFsbHkoKSAlPiUKICBzdW1tYXJpc2UoeWVhcnNfZGF0YSA9IG4oKSkKCjIwMTAgLSAxOTc3ICsgMQogIApET05PSFVFX0FHRV9HUk9VUFMgPC0gYygiMTUgdG8gMTkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAiMjAgdG8gMjQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAiMjUgdG8gMjkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAiMzAgdG8gMzQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAiMzUgdG8gMzkgeWVhcnMiKQoKRE9OT0hVRV9SQUNFIDwtIGMoIldoaXRlIiwKICAgICAgICAgICAgICAgICAgIkJsYWNrIiwKICAgICAgICAgICAgICAgICAgIk90aGVyIikKCkRPTk9IVUVfU0VYIDwtIGMoIk1hbGUiKQoKZGVtX0RPTk9IVUUgPC0gZGVtICU+JQogIGZpbHRlcihBR0VfR1JPVVAgJWluJSBET05PSFVFX0FHRV9HUk9VUFMsCiAgICAgICAgIFJBQ0UgJWluJSBET05PSFVFX1JBQ0UsCiAgICAgICAgIFNFWCAlaW4lIERPTk9IVUVfU0VYKSAlPiUKICBtdXRhdGUoQUdFX0dST1VQID0gZmN0X2NvbGxhcHNlKEFHRV9HUk9VUCwgIjIwIHRvIDM5IHllYXJzIj1jKCIyMCB0byAyNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMjUgdG8gMjkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjMwIHRvIDM0IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzNSB0byAzOSB5ZWFycyIpKSkgJT4lCiAgbXV0YXRlKEFHRV9HUk9VUCA9IHN0cl9yZXBsYWNlX2FsbChBR0VfR1JPVVAsIiAiLCJfIikpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCkgJT4lCiAgc3VtbWFyaXNlKFBFUkNfU1VCX1BPUCA9IHN1bShQRVJDX1NVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAlPiUKICB1bml0ZShjb2wgPSAiVkFSSUFCTEUiLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCwgc2VwID0gIl8iKSAlPiUKICByZW5hbWUoIlZBTFVFIj1QRVJDX1NVQl9QT1ApCgpMT1RUX0FHRV9HUk9VUFNfTlVMTCA8LSBjKCJVbmRlciA1IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAiNSB0byA5IHllYXJzIikKCkxPVFRfUkFDRSA8LSBjKCJXaGl0ZSIsCiAgICAgICAgICAgICAgICJCbGFjayIsCiAgICAgICAgICAgICAgICJPdGhlciIpCgpMT1RUX1NFWCA8LSBjKCJNYWxlIiwKICAgICAgICAgICAgICAiRmVtYWxlIikKCmRlbV9MT1RUIDwtIGRlbSAlPiUKICBmaWx0ZXIoIShBR0VfR1JPVVAgJWluJSBMT1RUX0FHRV9HUk9VUFNfTlVMTCksCiAgICAgICAgIFJBQ0UgJWluJSBMT1RUX1JBQ0UsCiAgICAgICAgIFNFWCAlaW4lIExPVFRfU0VYKSAlPiUKICBtdXRhdGUoQUdFX0dST1VQID0gZmN0X2NvbGxhcHNlKEFHRV9HUk9VUCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIxMCB0byAxOSB5ZWFycyI9YygiMTAgdG8gMTQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIxNSB0byAxOSB5ZWFycyIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjIwIHRvIDI5IHllYXJzIj1jKCIyMCB0byAyNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjI1IHRvIDI5IHllYXJzIiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMzAgdG8gMzkgeWVhcnMiPWMoIjMwIHRvIDM0IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMzUgdG8gMzkgeWVhcnMiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI0MCB0byA0OSB5ZWFycyI9YygiNDAgdG8gNDQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI0NSB0byA0OSB5ZWFycyIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjUwIHRvIDY0IHllYXJzIj1jKCI1MCB0byA1NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjU1IHRvIDU5IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNjAgdG8gNjQgeWVhcnMiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI2NSB5ZWFycyBhbmQgb3ZlciI9YygiNjUgdG8gNjkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI3MCB0byA3NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjc1IHRvIDc5IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiODAgdG8gODQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI4NSB5ZWFycyBhbmQgb3ZlciIpKSkgJT4lCiAgbXV0YXRlKEFHRV9HUk9VUCA9IHN0cl9yZXBsYWNlX2FsbChBR0VfR1JPVVAsIiAiLCJfIikpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCkgJT4lCiAgc3VtbWFyaXNlKFBFUkNfU1VCX1BPUCA9IHN1bShQRVJDX1NVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAlPiUKICB1bml0ZShjb2wgPSAiVkFSSUFCTEUiLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCwgc2VwID0gIl8iKSAlPiUKICByZW5hbWUoIlZBTFVFIj1QRVJDX1NVQl9QT1ApCiAgCmRpbShleHBhbmQuZ3JpZChjKDE6NiksIGMoNzo4KSwgYyg5OjEwKSkpWzFdCmBgYAoKYGBge3J9CnNldGVxdWFsKGNvbG5hbWVzKHBvcF83N183OSksY29sbmFtZXMocG9wXzgwXzg5KSkKc2V0ZXF1YWwoY29sbmFtZXMocG9wXzgwXzg5KSxjb2xuYW1lcyhwb3BfOTBfOTkpKQpzZXRlcXVhbChjb2xuYW1lcyhwb3BfOTBfOTkpLGNvbG5hbWVzKHBvcF8wMF8xMCkpCgpoZWFkKHBvcF83N183OSkKaGVhZChwb3BfODBfODkpCmhlYWQocG9wXzkwXzk5KQpoZWFkKHBvcF8wMF8xMCkKCnBvcHVsYXRpb25fZGF0YSA8LSBiaW5kX3Jvd3MocG9wXzc3Xzc5LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBvcF84MF84OSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwb3BfOTBfOTksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcG9wXzAwXzEwKQoKcG9wdWxhdGlvbl9kYXRhICU+JQogIGdyb3VwX2J5KFlFQVIpICU+JQogIHRhbGx5KCkgJT4lCiAgcHJpbnQobiA9IGRpbSguKVsxXSkKCnBvcHVsYXRpb25fZGF0YSA8LSBwb3B1bGF0aW9uX2RhdGEgJT4lCiAgbXV0YXRlKFZBUklBQkxFID0gIlBvcHVsYXRpb24iKSAlPiUKICByZW5hbWUoIlZBTFVFIj1UT1RfUE9QKQpgYGAKCiMjIFBvbGljZSBzdGFmZmluZwoKCmBgYHtyfQpjb2xuYW1lcyhwc19kYXRhKQoKcHNfZGF0YSA8LSBwc19kYXRhICU+JQogIGZpbHRlcihkYXRhX3llYXIgPj0gMTk3NywgCiAgICAgICAgIGRhdGFfeWVhciA8PSAyMDE0KSAlPiUKICBtdXRhdGUobWFsZV90b3RhbF9jdCA9IGNhc2Vfd2hlbihpcy5uYShtYWxlX3RvdGFsX2N0KSB+IDAsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+IG1hbGVfdG90YWxfY3QpLAogICAgICAgICBmZW1hbGVfdG90YWxfY3QgPSBjYXNlX3doZW4oaXMubmEoZmVtYWxlX3RvdGFsX2N0KSB+IDAsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+IGZlbWFsZV90b3RhbF9jdCkpICU+JQogIG11dGF0ZShvZmZpY2VyX3RvdGFsID0gbWFsZV90b3RhbF9jdCArIGZlbWFsZV90b3RhbF9jdCkgJT4lCiAgZHBseXI6OnNlbGVjdChkYXRhX3llYXIsCiAgICAgICAgICAgICAgICBwdWJfYWdlbmN5X25hbWUsCiAgICAgICAgICAgICAgICBzdGF0ZV9hYmJyLAogICAgICAgICAgICAgICAgb2ZmaWNlcl90b3RhbCkKCnBzX2RhdGEgPC0gcHNfZGF0YSAlPiUKICBncm91cF9ieShkYXRhX3llYXIsIHN0YXRlX2FiYnIpICU+JQogIHN1bW1hcmlzZShvZmZpY2VyX3N0YXRlX3RvdGFsPXN1bShvZmZpY2VyX3RvdGFsKSwgLmdyb3VwcyA9ICJkcm9wIikKCnBzX2RhdGEgJT4lCiAgZ3JvdXBfYnkoc3RhdGVfYWJicikgJT4lCiAgdGFsbHkoKSAlPiUKICBwcmludChuID0gZGltKC4pWzFdKQoKIyBOQiBpcyBOZWJyYXNrYS4gVGhpcyB3YXMgY2hhbmdlZCB0byBORSB0byBhdm9pZCBjb25mdXNpb25zIHdpdGggTkIgaW4gQ2FuYWRhLiBUaGlzIGRhdGFzZXQgdXNlcyBOQgoKc3RhdGVfb2ZfaW50ZXJlc3RfTlVMTCA8LSBjKCJBUyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAiR00iLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIkNaIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICJGUyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAiTVAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIk9UIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICJQUiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAiVkkiKQoKc3RhdGVfYWJiX2RmIDwtIGFzLmRhdGEuZnJhbWUoY2JpbmQoc3RhdGUuYWJiLCBzdGF0ZS5uYW1lKSkKCmNvbG5hbWVzKHN0YXRlX2FiYl9kZikgPC0gYygic3RhdGVfYWJiciIsICJTVEFURSIpCgpwcmludChzdGF0ZV9hYmJfZGYpCgpzdGF0ZV9hYmJfZGYgPC0gc3RhdGVfYWJiX2RmICU+JQogIGFkZF9yb3coc3RhdGVfYWJicj0iREMiLAogICAgICAgICAgU1RBVEU9IkRpc3RyaWN0IG9mIENvbHVtYmlhIikKCmRlbm9taW5hdG9yX3RlbXAgPC0gcG9wdWxhdGlvbl9kYXRhICU+JQogIGRwbHlyOjpzZWxlY3QoLVZBUklBQkxFKSAlPiUKICByZW5hbWUoIlBvcHVsYXRpb25fdGVtcCI9VkFMVUUpCgpwc19kYXRhIDwtIHBzX2RhdGEgJT4lCiAgZmlsdGVyKCEoc3RhdGVfYWJiciAlaW4lIHN0YXRlX29mX2ludGVyZXN0X05VTEwpKSAlPiUKICBtdXRhdGUoc3RhdGVfYWJiciA9IGNhc2Vfd2hlbihzdGF0ZV9hYmJyID09ICJOQiIgfiAiTkUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiBzdGF0ZV9hYmJyKSkgJT4lCiAgbGVmdF9qb2luKHN0YXRlX2FiYl9kZiwgYnkgPSAic3RhdGVfYWJiciIpICU+JQogIGRwbHlyOjpzZWxlY3QoLXN0YXRlX2FiYnIpICU+JQogIHJlbmFtZShZRUFSID0gImRhdGFfeWVhciIsCiAgICAgICAgIFZBTFVFID0gIm9mZmljZXJfc3RhdGVfdG90YWwiKSAlPiUKICBtdXRhdGUoVkFSSUFCTEUgPSAib2ZmaWNlcl9zdGF0ZV90b3RhbCIpICU+JQogIGxlZnRfam9pbihkZW5vbWluYXRvcl90ZW1wLCBieT1jKCJTVEFURSIsIllFQVIiKSkgJT4lCiAgbXV0YXRlKFZBTFVFID0gKFZBTFVFKjEwMDAwMCkgLyBQb3B1bGF0aW9uX3RlbXApICU+JQogIG11dGF0ZShWQUxVRSA9IGxhZyhWQUxVRSkpICU+JQogIG11dGF0ZShWQVJJQUJMRSA9ICJwb2xpY2VfcGVyXzEwMGtfbGFnIikgJT4lCiAgZHBseXI6OnNlbGVjdCgtUG9wdWxhdGlvbl90ZW1wKQpgYGAKCiMjIFVuZW1wbG95bWVudAoKCmBgYHtyfQoKCm5hbWVzKHVlX3JhdGVfZGF0YSkgPC0gdWVfcmF0ZV9uYW1lcwoKdWVfcmF0ZV9kYXRhJEFsYWJhbWFbZGltKHVlX3JhdGVfZGF0YSRBbGFiYW1hKVsxXSxdCgp1ZV9yYXRlX2RhdGEgPC0gdWVfcmF0ZV9kYXRhICU+JQogIG1hcF9kZihiaW5kX3Jvd3MsIC5pZCA9ICJTVEFURSIpCgpjb2xuYW1lcyh1ZV9yYXRlX2RhdGEpCgpzYXBwbHkodWVfcmF0ZV9kYXRhLCBjbGFzcykKCnVlX3JhdGVfZGF0YSA8LSB1ZV9yYXRlX2RhdGEgJT4lCiAgbXV0YXRlKFllYXIgPSBhcy5udW1lcmljKFllYXIpKSAlPiUKICBkcGx5cjo6c2VsZWN0KFNUQVRFLCBZZWFyLCBBbm51YWwpICU+JQogIHJlbmFtZSgiWUVBUiI9WWVhciwKICAgICAgICAgIlZBTFVFIj1Bbm51YWwpICU+JQogIG11dGF0ZShWQVJJQUJMRT0iVW5lbXBsb3ltZW50X3JhdGUiKQpgYGAKCiMjIFBvdmVydHkgcmF0ZQoKCmBgYHtyfQpoZWFkKHBvdmVydHlfcmF0ZV9kYXRhKQoKY29sbmFtZXMocG92ZXJ0eV9yYXRlX2RhdGEpIDwtIGMoIlNUQVRFIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIlRvdGFsIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIk51bWJlciIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJOdW1iZXJfc2UiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiUGVyY2VudCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJQZXJjZW50X3NlIikKCnRhaWwocG92ZXJ0eV9yYXRlX2RhdGEpCgpub3RlcyA8LSA0Cgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YVstKChkaW0ocG92ZXJ0eV9yYXRlX2RhdGEpWzFdLW5vdGVzKzEpOmRpbShwb3ZlcnR5X3JhdGVfZGF0YSlbMV0pLF0KCnN0YXRlc19lcSA8LSA1MQoKZXh0cmFfY29sIDwtIDIKCnJlcF9yb3dzIDwtIHN0YXRlc19lcSArIGV4dHJhX2NvbAoKZ3JvdXBzIDwtIChkaW0ocG92ZXJ0eV9yYXRlX2RhdGEpWzFdKS8ocmVwX3Jvd3MpCgpwYXN0ZShncm91cHMgLSAoMjAxOC0xOTgwICsgMSksICJleHRyYSBncm91cHMiKQoKcG92ZXJ0eV9yYXRlX2RhdGEkeWVhcl9ncm91cCA8LSByZXAoMTpncm91cHMsIGVhY2g9cmVwX3Jvd3MpCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YSAlPiUKICBncm91cF9ieSh5ZWFyX2dyb3VwKSAlPiUKICBncm91cF9zcGxpdCgpCgpoZWFkKHBvdmVydHlfcmF0ZV9kYXRhW1sxXV0pCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YSAlPiUKICBtYXAofm11dGF0ZSguLAogICAgICAgICAgICAgIHJvd19pZCA9IHJvd19udW1iZXIoKSkpICU+JQogIG1hcCh+ZmlsdGVyKC4scm93X2lkICE9IDIpKSAlPiUKICBtYXAofmRwbHlyOjpzZWxlY3QoLiwtcm93X2lkKSkKCnBvdmVydHlfcmF0ZV9kYXRhX25hbWVzIDwtIHBvdmVydHlfcmF0ZV9kYXRhICU+JQogIHNhcHBseSguLCAiWyIsMSwxLCBkcm9wPVRSVUUpICU+JQogIHN0cl9yZXBsYWNlX2FsbCguLCJbOnNwYWNlOl0iLCJfIikKCm5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKSA8LSBwb3ZlcnR5X3JhdGVfZGF0YV9uYW1lcwoKIyBSZWNhbGwgMiBleHRyYSBncm91cHMuIAojIGZvb3Rub3RlcyBhdmFpbGFibGUgYXQgaHR0cHM6Ly93d3cuY2Vuc3VzLmdvdi90b3BpY3MvaW5jb21lLXBvdmVydHkvcG92ZXJ0eS9ndWlkYW5jZS9wb3ZlcnR5LWZvb3Rub3Rlcy9jcHMtaGlzdG9yaWMtZm9vdG5vdGVzLmh0bWwKCnBvdmVydHlfcmF0ZV9kYXRhJGAyMDE3XygyMSlgIDwtIE5VTEwKCnBvdmVydHlfcmF0ZV9kYXRhJGAyMDEzXygxOSlgIDwtIE5VTEwKCnBvdmVydHlfcmF0ZV9kYXRhX25hbWVzIDwtIHBvdmVydHlfcmF0ZV9kYXRhICU+JQogIHNhcHBseSguLCAiWyIsMSwxLCBkcm9wPVRSVUUpICU+JQogIHN0cl9zdWIoLiwgc3RhcnQgPSAxLCBlbmQ9NCkKCm5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKSA8LSBwb3ZlcnR5X3JhdGVfZGF0YV9uYW1lcwoKcG92ZXJ0eV9yYXRlX2RhdGEgPC0gcG92ZXJ0eV9yYXRlX2RhdGEgJT4lCiAgbWFwX2RmKGJpbmRfcm93cywgLmlkID0gIllFQVIiKSAlPiUKICBkcGx5cjo6c2VsZWN0KC15ZWFyX2dyb3VwKQoKcG92ZXJ0eV9yYXRlX2RhdGEgPC0gcG92ZXJ0eV9yYXRlX2RhdGEgJT4lCiAgICBtdXRhdGUobl9uYSA9IHJvd1N1bXMoaXMubmEoLikpKSAKCiMgVGhpcyBzaG93cyB0aGF0IHRoZXJlIGlzIHN5c3RlbWF0aWMgbWlzc2luZyB2YWx1ZXMgc3RlbW1pbmdseSAqc29sZWx5KiBmcm9tIHRoZSByb3dzIHdpdGhvdXQgcG92ZXJ0eSBkYXRhIGFuZCBvbmx5IGEgbGFiZWwgZGVzaWduYXRpbmcgdGhlIHllYXIKcG92ZXJ0eV9yYXRlX2RhdGEgJT4lIAogIGdyb3VwX2J5KG5fbmEpICU+JQogIHRhbGx5KCkKCnNhcHBseShwb3ZlcnR5X3JhdGVfZGF0YSwgY2xhc3MpCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YSAlPiUKICBkcm9wX25hKCkgJT4lCiAgZHBseXI6OnNlbGVjdCgtTnVtYmVyLAogICAgICAgICAgICAgICAgLU51bWJlcl9zZSwKICAgICAgICAgICAgICAgIC1QZXJjZW50X3NlLAogICAgICAgICAgICAgICAgLW5fbmEsCiAgICAgICAgICAgICAgICAtVG90YWwpICU+JQogIHJlbmFtZSgiVkFMVUUiPVBlcmNlbnQpICU+JQogIG11dGF0ZShWQVJJQUJMRSA9ICJQb3ZlcnR5X3JhdGUiLAogICAgICAgICBZRUFSID0gYXMubnVtZXJpYyhZRUFSKSwKICAgICAgICAgVkFMVUUgPSBhcy5udW1lcmljKFZBTFVFKSkKCmNvbG5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKQpgYGAKCiMjIFZpb2xlbnQgY3JpbWUKCmh0dHBzOi8vd3d3LnVjcmRhdGF0b29sLmdvdi9TZWFyY2gvQ3JpbWUvU3RhdGUvU3RhdGVieVN0YXRlLmNmbQoKYGBge3J9CmNyaW1lX2RhdGEgPC0gcmVhZF9saW5lcygiZG9jcy9DcmltZS9DcmltZVN0YXRlYnlTdGF0ZS5jc3YiLCBza2lwID0gMiwgc2tpcF9lbXB0eV9yb3dzID0gVFJVRSkKCmxlbmd0aChjcmltZV9kYXRhKQoKY3JpbWVfZGF0YSA8LSBjcmltZV9kYXRhWy0oMjE0MzpsZW5ndGgoY3JpbWVfZGF0YSkpXQoKeCA8LSAyMDE0LTE5NzcrMQoKcmVwX2N5Y2xlIDwtIDIgKyAyICsgeAoKcmVwX2N5Y2xlX2N1dCA8LSAyICsgeAoKZGVsZXRlX3Jvd3MgPC0gYyhzZXEoMixsZW5ndGgoY3JpbWVfZGF0YSkscmVwX2N5Y2xlKSwKICAgICAgICAgICAgICAgICBzZXEoMyxsZW5ndGgoY3JpbWVfZGF0YSkscmVwX2N5Y2xlKSkKCmNyaW1lX2RhdGEgPC0gY3JpbWVfZGF0YVstZGVsZXRlX3Jvd3NdCgpjcmltZV9kYXRhIDwtIGRhdGEuZnJhbWUoY2JpbmQoY3JpbWVfZGF0YSwgcmVwKDE6KGxlbmd0aChjcmltZV9kYXRhKS9yZXBfY3ljbGVfY3V0KSxlYWNoPXJlcF9jeWNsZV9jdXQpKSkKCmNvbG5hbWVzKGNyaW1lX2RhdGEpIDwtIGMoIlN0cmluZyIsIlNUQVRFX0dST1VQIikKCmNyaW1lX2RhdGEgPC0gY3JpbWVfZGF0YSAlPiUKICBncm91cF9ieShTVEFURV9HUk9VUCkgJT4lCiAgZ3JvdXBfc3BsaXQoKQoKY29sdW1uc19jcmltZV9kYXRhIDwtIDgKCmNyaW1lX2RhdGEgPC0gY3JpbWVfZGF0YSAlPiUKICBtYXAofm11dGF0ZSguLAogICAgICAgICAgICAgICBTdGF0ZSA9IGNhc2Vfd2hlbihzdHJfZGV0ZWN0KFN0cmluZywgIkVzdGltYXRlZCBjcmltZSBpbiAiKSB+IHN1YnN0cmluZyhTdHJpbmcsIG5jaGFyKCJFc3RpbWF0ZWQgY3JpbWUgaW4gIikrMSkpLAogICAgICAgICAgICAgIHJvd19pZCA9IHJvd19udW1iZXIoKSkpICU+JQogIG1hcCh+ZmlsbCguLCBTdGF0ZSkpICU+JQogIG1hcCh+ZmlsdGVyKC4scm93X2lkID4gMikpICU+JQogIG1hcCh+bXV0YXRlKC4sCiAgICAgICAgICAgICAgU3RyaW5nID0gcGFzdGUwKFN0cmluZywgIiwiLCBTdGF0ZSkpKSAlPiUKICBtYXAofmRwbHlyOjpzZWxlY3QoLixTdHJpbmcpKSAlPiUKICBtYXAofnN0cl9zcGxpdF9maXhlZCguJFN0cmluZywiLCIsY29sdW1uc19jcmltZV9kYXRhICsgMSkpICU+JQogIG1hcCh+ZGF0YS5mcmFtZSguKSkgJT4lCiAgbWFwKH5yZW5hbWUoLiwiWUVBUiI9WDEsCiAgICAgICAgICAgICAgIkV4dHJhX2NvbDEiPVgyLAogICAgICAgICAgICAgICJWQyI9WDMsCiAgICAgICAgICAgICAgIkV4dHJhX2NvbDIiPVg0LAogICAgICAgICAgICAgICJFeHRyYV9jb2wzIj1YNSwKICAgICAgICAgICAgICAiRXh0cmFfY29sNCI9WDYsCiAgICAgICAgICAgICAgIkV4dHJhX2NvbDUiPVg3LAogICAgICAgICAgICAgICJFeHRyYV9jb2w2Ij1YOCwKICAgICAgICAgICAgICAiU1RBVEUiPVg5KSkgJT4lCiAgbWFwKH5kcGx5cjo6c2VsZWN0KC4sLWNvbnRhaW5zKCJFeHRyYV9jb2wiKSkpICU+JQogIG1hcCh+LnggJT4lIG11dGF0ZV9hbGwofnRyaW13cyguLHdoaWNoID0gImJvdGgiKSkpICU+JQogIG1hcF9kZihiaW5kX3Jvd3MpCgpzYXBwbHkoY3JpbWVfZGF0YSwgY2xhc3MpCgpjcmltZV9kYXRhIDwtIGNyaW1lX2RhdGEgJT4lCiAgbXV0YXRlKFZBUklBQkxFID0gIlZpb2xfY3JpbWVfY291bnQiKSAlPiUKICByZW5hbWUoIlZBTFVFIiA9IFZDKSAlPiUKICBhcy50aWJibGUoKSAlPiUKICBtdXRhdGUoWUVBUiA9IGFzLm51bWVyaWMoWUVBUiksCiAgICAgICAgIFZBTFVFID0gYXMubnVtZXJpYyhWQUxVRSkpCmBgYAoKIyMgUlRDIGxhd3MKCgpgYGB7cn0KREFXcGFwZXJfcF82MiA8LSBEQVdwYXBlcltbNjJdXQoKcF82MiA8LSBEQVdwYXBlcl9wXzYyICU+JQogICAgc3Ryc3BsaXQoIlxuIikgJT4lCiAgICB1bmxpc3QoKSAlPiUKICAgIGFzLmRhdGEuZnJhbWUoKSAlPiUKICAgIHNsaWNlKC0oMToyKSkKCmFwcGx5KHBfNjIsIDEsIG5jaGFyKQoKcF82Mls1MyxdICNwaHlzY2lhbCBwYWdlIDYwCgpwXzYyIDwtIHBfNjIgJT4lCiAgICBzbGljZSgtNTMpCgphcHBseShwXzYyLCAxLCBzdHJfY291bnQsICJcXHN7NSx9IikKYXBwbHkocF82MiwgMSwgc3RyX2NvdW50LCAiXFxzezEwLH0iKQphcHBseShwXzYyLCAxLCBzdHJfY291bnQsICJcXHN7MjAsfSIpCmFwcGx5KHBfNjIsIDEsIHN0cl9jb3VudCwgIlxcc3s0MCx9IikKCmhlYWQoY2JpbmQocF82MiwgYXBwbHkocF82MiwgMSwgc3RyX2NvdW50LCAiXFxzezQwLH0iKSkpCgpwXzYyIDwtIHBfNjIgJT4lCiAgICBhcHBseSgxLHN0cl9yZXBsYWNlX2FsbCwgIlxcc3s0MCx9IiwgInxOL0F8IikgJT4lCiAgICBzdHJfcmVwbGFjZV9hbGwoIlxcc3syLDE1fSIsICJ8IikgJT4lCiAgICBhcy5kYXRhLmZyYW1lKCkKCnBfNjIgPC0gc2FwcGx5KHBfNjIkLiwgc3RyX3NwbGl0LCAiXFx8ezEsfSIpCgpzYXBwbHkocF82MiwgbmNoYXIpCgpwXzYyIDwtIGxhcHBseShwXzYyLCBmdW5jdGlvbih4KSB4W25jaGFyKHgpID4gMF0pIAoKcF82MiA8LSBhcy5kYXRhLmZyYW1lKGRvLmNhbGwocmJpbmQsIHBfNjIpKQoKcm93bmFtZXMocF82MikKCnJvd25hbWVzKHBfNjIpIDwtIGMoKQoKY29sbmFtZXMocF82MikgPC0gYygiU1RBVEUiLAogICAgICAgICAgICAgICAgICAgICJFX0RhdGVfUlRDIiwKICAgICAgICAgICAgICAgICAgICAiRnJhY19Zcl9FZmZfWXJfUGFzcyIsCiAgICAgICAgICAgICAgICAgICAgIlJUQ19EYXRlX1NBIikKc2FwcGx5KHBfNjIsIGNsYXNzKQoKcF82MiA8LSBwXzYyICU+JQogIGRwbHlyOjpzZWxlY3QoU1RBVEUsIFJUQ19EYXRlX1NBKSAlPiUKICByZW5hbWUoIlJUQ19MQVdfWUVBUiI9UlRDX0RhdGVfU0EpICU+JQogIG11dGF0ZShSVENfTEFXX1lFQVIgPSBhcy5udW1lcmljKFJUQ19MQVdfWUVBUikpICU+JQogIG11dGF0ZShSVENfTEFXX1lFQVIgPSBjYXNlX3doZW4oUlRDX0xBV19ZRUFSID09IDAgfiBJbmYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiBSVENfTEFXX1lFQVIpKQoKc2FwcGx5KHBfNjIsIGNsYXNzKQoKaGVhZChwXzYyKQpgYGAKCiMjIENoZWNrcG9pbnQKCmBgYHtyfQpjb2xuYW1lcyhkZW1fRE9OT0hVRSkKY29sbmFtZXMoZGVtX0xPVFQpCmNvbG5hbWVzKHVlX3JhdGVfZGF0YSkKY29sbmFtZXMocG92ZXJ0eV9yYXRlX2RhdGEpCmNvbG5hbWVzKGNyaW1lX2RhdGEpCgpoZWFkKGRlbV9ET05PSFVFKQpoZWFkKGRlbV9MT1RUKQpoZWFkKHVlX3JhdGVfZGF0YSkKaGVhZChwb3ZlcnR5X3JhdGVfZGF0YSkKaGVhZChjcmltZV9kYXRhKQpgYGAKCiMjIEpvaW4KCiMjIERvbm9odWUsIGV0IGFsLgoKYGBge3J9CkRPTk9IVUVfREYgPC0gYmluZF9yb3dzKGRlbV9ET05PSFVFLAogICAgICAgICAgICAgICAgICAgICAgICB1ZV9yYXRlX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgIHBvdmVydHlfcmF0ZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICAgICBjcmltZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICAgICBwb3B1bGF0aW9uX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgIHBzX2RhdGEpICU+JQogIHBpdm90X3dpZGVyKG5hbWVzX2Zyb20gPSAiVkFSSUFCTEUiLAogICAgICAgICAgICAgIHZhbHVlc19mcm9tID0gIlZBTFVFIikgJT4lCiAgbGVmdF9qb2luKHBfNjIgLCBieSA9IGMoIlNUQVRFIikpICU+JQogIG11dGF0ZShSVENfTEFXID0gY2FzZV93aGVuKFlFQVIgPj0gUlRDX0xBV19ZRUFSIH4gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+IEZBTFNFKSkKCkRPTk9IVUVfREYgJT4lCiAgZ3JvdXBfYnkoWUVBUikgJT4lCiAgdGFsbHkoKSAlPiUKICBmaWx0ZXIobiAhPSA1MSkgJT4lCiAgcHJpbnQobj1kaW0oLilbMV0pCgpzdW1tYXJ5KGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkKCm1heChET05PSFVFX0RGJFlFQVIpIC0gbWluKERPTk9IVUVfREYkWUVBUikgKyAxCgpET05PSFVFX0RGIDwtIERPTk9IVUVfREYgJT4lCiAgbXV0YXRlKFNUQVRFID0gZmN0X2NvbGxhcHNlKFNUQVRFLCAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiPWMoIkRpc3RyaWN0IG9mIENvbHVtYmlhIiwiRC5DLiIpKSkKCnN1bW1hcnkoYXMuZmFjdG9yKERPTk9IVUVfREYkU1RBVEUpKQogIApsZW5ndGgobGV2ZWxzKERPTk9IVUVfREYkU1RBVEUpKQoKRE9OT0hVRV9ERiA8LSBET05PSFVFX0RGICU+JQogIGdyb3VwX2J5KFNUQVRFLCBZRUFSKSAlPiUKICBzdW1tYXJpc2VfYWxsKH5uYS5vbWl0KHVuaXF1ZSguKSkpICU+JQogIHVuZ3JvdXAoKSAjIFRoaXMgaWRlbnRpZmllcyB1bmlxdWUgb2JzZXJ2YXRpb25zLCBjb2FsZXNjZXMgcm93cyBhY2NvcmRpbmcgdG8gdGhlIGdyb3VwaW5nIHZhcmlhYmxlKHMpLCBhbmQgZ2V0cyByaWQgb2Ygb2YgdW5pdHMgdGhhdCBoYXZlIGluY29tcGxldGUgZGF0YS4gVGhpcyBnaXZlcyByZXR1cm5zIGEgZGF0YWZyYW1lIHdpdGggdGhlIG1vc3QgY29tcGxldGUgaW5mb3JtYXRpb24uCgpzdW1tYXJ5KGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkgCgpiYXNlbGluZV95ZWFyIDwtIG1pbihET05PSFVFX0RGJFlFQVIpCmNlbnNvcmluZ195ZWFyIDwtIG1heChET05PSFVFX0RGJFlFQVIpCgojIE5lZWQgdG8gZml4IHRoaXMgdG8gZW5zdXJlIHNldmVyZSBiaWFzIGlzIG5vdCBpbnRyb2R1Y2VkIGJ5IHByZXZhbGVudCAiY2FzZXMiCgpET05PSFVFX0RGIDwtIERPTk9IVUVfREYgJT4lCiAgbXV0YXRlKFRJTUVfMCA9IGJhc2VsaW5lX3llYXIsCiAgICAgICAgIFRJTUVfSU5GID0gY2Vuc29yaW5nX3llYXIpICU+JQogIGZpbHRlcihSVENfTEFXX1lFQVIgPiBUSU1FXzApCgpET05PSFVFX0RGIDwtIERPTk9IVUVfREYgJT4lCiAgbXV0YXRlKFZpb2xfY3JpbWVfcmF0ZV8xayA9IChWaW9sX2NyaW1lX2NvdW50KjEwMDApL1BvcHVsYXRpb24sCiAgICAgICAgIFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgPSBsb2coVmlvbF9jcmltZV9yYXRlXzFrKSwKICAgICAgICAgUG9wdWxhdGlvbl9sb2cgPSBsb2coUG9wdWxhdGlvbikpCgpzdW1tYXJ5KGRyb3BsZXZlbHMoYXMuZmFjdG9yKERPTk9IVUVfREYkU1RBVEUpKSkKCmxlbmd0aChzdW1tYXJ5KGRyb3BsZXZlbHMoYXMuZmFjdG9yKERPTk9IVUVfREYkU1RBVEUpKSkpCmBgYAoKIyMgTG90dCBhbmQgTXVzdGFyZAoKYGBge3J9CkxPVFRfREYgPC0gYmluZF9yb3dzKGRlbV9MT1RULAogICAgICAgICAgICAgICAgICAgICB1ZV9yYXRlX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgIHBvdmVydHlfcmF0ZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICBjcmltZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICBwb3B1bGF0aW9uX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgIHBzX2RhdGEpICU+JQogIHBpdm90X3dpZGVyKG5hbWVzX2Zyb20gPSAiVkFSSUFCTEUiLAogICAgICAgICAgICAgIHZhbHVlc19mcm9tID0gIlZBTFVFIikgJT4lCiAgbGVmdF9qb2luKHBfNjIgLCBieSA9IGMoIlNUQVRFIikpICU+JQogIG11dGF0ZShSVENfTEFXID0gY2FzZV93aGVuKFlFQVIgPj0gUlRDX0xBV19ZRUFSIH4gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+IEZBTFNFKSkKCkxPVFRfREYgJT4lCiAgZ3JvdXBfYnkoWUVBUikgJT4lCiAgdGFsbHkoKSAlPiUKICBmaWx0ZXIobiAhPSA1MSkgJT4lCiAgcHJpbnQobj1kaW0oLilbMV0pCgpzdW1tYXJ5KGFzLmZhY3RvcihMT1RUX0RGJFNUQVRFKSkKCm1heChMT1RUX0RGJFlFQVIpIC0gbWluKExPVFRfREYkWUVBUikgKyAxCgpMT1RUX0RGIDwtIExPVFRfREYgJT4lCiAgbXV0YXRlKFNUQVRFID0gZmN0X2NvbGxhcHNlKFNUQVRFLCAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiPWMoIkRpc3RyaWN0IG9mIENvbHVtYmlhIiwiRC5DLiIpKSkKCnN1bW1hcnkoYXMuZmFjdG9yKExPVFRfREYkU1RBVEUpKQogIApsZW5ndGgobGV2ZWxzKExPVFRfREYkU1RBVEUpKQoKTE9UVF9ERiA8LSBMT1RUX0RGICU+JQogIGdyb3VwX2J5KFNUQVRFLCBZRUFSKSAlPiUKICBzdW1tYXJpc2VfYWxsKH5uYS5vbWl0KHVuaXF1ZSguKSkpICU+JQogIHVuZ3JvdXAoKSAjIFRoaXMgaWRlbnRpZmllcyB1bmlxdWUgb2JzZXJ2YXRpb25zLCBjb2FsZXNjZXMgcm93cyBhY2NvcmRpbmcgdG8gdGhlIGdyb3VwaW5nIHZhcmlhYmxlKHMpLCBhbmQgZ2V0cyByaWQgb2Ygb2YgdW5pdHMgdGhhdCBoYXZlIGluY29tcGxldGUgZGF0YS4gVGhpcyBnaXZlcyByZXR1cm5zIGEgZGF0YWZyYW1lIHdpdGggdGhlIG1vc3QgY29tcGxldGUgaW5mb3JtYXRpb24uCgpzdW1tYXJ5KGFzLmZhY3RvcihMT1RUX0RGJFNUQVRFKSkgCgpiYXNlbGluZV95ZWFyIDwtIG1pbihMT1RUX0RGJFlFQVIpCmNlbnNvcmluZ195ZWFyIDwtIG1heChMT1RUX0RGJFlFQVIpCgojIE5lZWQgdG8gZml4IHRoaXMgdG8gZW5zdXJlIHNldmVyZSBiaWFzIGlzIG5vdCBpbnRyb2R1Y2VkIGJ5IHByZXZhbGVudCAiY2FzZXMiCgpMT1RUX0RGIDwtIExPVFRfREYgJT4lCiAgbXV0YXRlKFRJTUVfMCA9IGJhc2VsaW5lX3llYXIsCiAgICAgICAgIFRJTUVfSU5GID0gY2Vuc29yaW5nX3llYXIpICU+JQogIGZpbHRlcihSVENfTEFXX1lFQVIgPiBUSU1FXzApCgpMT1RUX0RGIDwtIExPVFRfREYgJT4lCiAgbXV0YXRlKFZpb2xfY3JpbWVfcmF0ZV8xayA9IChWaW9sX2NyaW1lX2NvdW50KjEwMDApL1BvcHVsYXRpb24sCiAgICAgICAgIFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgPSBsb2coVmlvbF9jcmltZV9yYXRlXzFrKSwKICAgICAgICAgUG9wdWxhdGlvbl9sb2cgPSBsb2coUG9wdWxhdGlvbikpCgpzdW1tYXJ5KGRyb3BsZXZlbHMoYXMuZmFjdG9yKExPVFRfREYkU1RBVEUpKSkKCmxlbmd0aChzdW1tYXJ5KGRyb3BsZXZlbHMoYXMuZmFjdG9yKExPVFRfREYkU1RBVEUpKSkpCmBgYAoKIyAqKkRhdGEgRXhwbG9yYXRpb24qKgoqKioKCmBgYHtyfQpzYXBwbHkoRE9OT0hVRV9ERiwgY2xhc3MpCgpET05PSFVFX0RGICU+JQogIG11dGF0ZShWaW9sX2NyaW1lX3JhdGVfMTAwa19sb2cgPSBsb2coKFZpb2xfY3JpbWVfY291bnQqMTAwMDAwKS9Qb3B1bGF0aW9uKSkgJT4lCiAgZ2dwbG90KGFlcyh4ID0gWUVBUiwgeSA9IFZpb2xfY3JpbWVfcmF0ZV8xMDBrX2xvZywgY29sb3IgPSBTVEFURSkpICsKICBnZW9tX3BvaW50KHNpemUgPSAwLjUpICsKICBnZW9tX2xpbmUoYWVzKGdyb3VwPVNUQVRFKSwKICAgICAgICAgICAgc2l6ZSA9IDAuNSwKICAgICAgICAgICAgc2hvdy5sZWdlbmQgPSBGQUxTRSkgKwogIGdlb21fdGV4dF9yZXBlbChkYXRhID0gRE9OT0hVRV9ERiAlPiUKICAgICAgICAgICAgICBtdXRhdGUoVmlvbF9jcmltZV9yYXRlXzEwMGtfbG9nID0gbG9nKChWaW9sX2NyaW1lX2NvdW50KjEwMDAwMCkvUG9wdWxhdGlvbikpICU+JQogICAgICAgICAgICAgIGZpbHRlcihZRUFSID09IGxhc3QoWUVBUikpLAogICAgICAgICAgICBhZXMobGFiZWwgPSBTVEFURSwKICAgICAgICAgICAgICAgIHggPSBZRUFSLAogICAgICAgICAgICAgICAgeSA9IFZpb2xfY3JpbWVfcmF0ZV8xMDBrX2xvZyksCiAgICAgICAgICAgIHNpemUgPSAzLAogICAgICAgICAgICBhbHBoYSA9IDEsCiAgICAgICAgICAgIG51ZGdlX3ggPSAxMCwKICAgICAgICAgICAgZGlyZWN0aW9uID0gInkiLAogICAgICAgICAgICBoanVzdCA9IDEsCiAgICAgICAgICAgIHZqdXN0ID0gMSwKICAgICAgICAgICAgc2VnbWVudC5zaXplID0gMC4yNSwKICAgICAgICAgICAgc2VnbWVudC5hbHBoYSA9IDAuMjUsCiAgICAgICAgICAgIGZvcmNlID0gMSwKICAgICAgICAgICAgbWF4Lml0ZXIgPSA5OTk5KSArCiAgZ3VpZGVzKGNvbG9yID0gRkFMU0UpICsKICBzY2FsZV94X2NvbnRpbnVvdXMoYnJlYWtzID0gc2VxKDE5ODAsIDIwMTUsIGJ5ID0gMSksCiAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoMTk4MCwgMjAxNSksCiAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IGMoc2VxKDE5ODAsIDIwMTAsIGJ5ID0gMSksIHJlcCgiIiwgNSkpKSArCiAgc2NhbGVfeV9jb250aW51b3VzKGJyZWFrcyA9IHNlcSgzLjUsIDguNSwgYnkgPSAwLjUpLAogICAgICAgICAgICAgICAgICAgICBsaW1pdHMgPSBjKDMuNSwgOC41KSkgKwogIGxhYnModGl0bGUgPSAiU3RhdGVzIGhhdmUgZGlmZmVyZW50IGxldmVscyBvZiBjcmltZSIsCiAgICAgICB4ID0gIlllYXIiLAogICAgICAgeSA9ICJsbih2aW9sZW50IGNyaW1lcyBwZXIgMTAwLDAwMCBwZW9wbGUpIikgKwogIHRoZW1lX21pbmltYWwoKSArCiAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCkpCgpET05PSFVFX0RGICU+JQogIGdyb3VwX2J5KFlFQVIpICU+JQogIHN1bW1hcmlzZShWaW9sX2NyaW1lX2NvdW50ID0gc3VtKFZpb2xfY3JpbWVfY291bnQpLAogICAgICAgICAgICBQb3B1bGF0aW9uID0gc3VtKFBvcHVsYXRpb24pLAogICAgICAgICAgICAuZ3JvdXBzID0gImRyb3AiKSAlPiUKICBtdXRhdGUoVmlvbF9jcmltZV9yYXRlXzEwMGtfbG9nID0gbG9nKChWaW9sX2NyaW1lX2NvdW50KjEwMDAwMCkvUG9wdWxhdGlvbikpICU+JQogIGdncGxvdChhZXMoeCA9IFlFQVIsIHkgPSBWaW9sX2NyaW1lX3JhdGVfMTAwa19sb2cpKSArCiAgZ2VvbV9saW5lKCkgKwogIHNjYWxlX3hfY29udGludW91cyhicmVha3MgPSBzZXEoMTk4MCwgMjAxMCwgYnkgPSAxKSwKICAgICAgICAgICAgICAgICAgICAgbGltaXRzID0gYygxOTgwLCAyMDEwKSwKICAgICAgICAgICAgICAgICAgICAgbGFiZWxzID0gYyhzZXEoMTk4MCwgMjAxMCwgYnkgPSAxKSkpICsKICBzY2FsZV95X2NvbnRpbnVvdXMoYnJlYWtzID0gc2VxKDUuNzUsIDYuNzUsIGJ5ID0gMC4yNSksCiAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoNS43NSwgNi43NSkpICsKICBsYWJzKHRpdGxlID0gIkNyaW1lIHJhdGVzIGZsdWN0dWF0ZSBvdmVyIHRpbWUiLAogICAgICAgeCA9ICJZZWFyIiwKICAgICAgIHkgPSAibG4odmlvbGVudCBjcmltZXMgcGVyIDEwMCwwMDAgcGVvcGxlKSIpICsKICB0aGVtZV9taW5pbWFsKCkgKyAKICB0aGVtZShheGlzLnRleHQueCA9IGVsZW1lbnRfdGV4dChhbmdsZSA9IDkwKSkKYGBgCgojICoqRGF0YSBBbmFseXNpcyoqCioqKgoKIyMgRG9ub2h1ZSwgZXQgYWwuCgpTb21lIGNvZGUgdGFrZW4gZnJvbSBodHRwOi8va2FydGh1ci5vcmcvMjAxOS9pbXBsZW1lbnRpbmctZml4ZWQtZWZmZWN0cy1wYW5lbC1tb2RlbHMtaW4tci5odG1sCgpgYGB7cn0KZF9wYW5lbF9ET05PSFVFIDwtIHBkYXRhLmZyYW1lKERPTk9IVUVfREYsIGluZGV4PWMoIlNUQVRFIiwgIllFQVIiKSkKCkRPTk9IVUVfT1VUUFVUIDwtIHBsbShWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIH4KICAgICAgICAgICAgICAgICAgICAgICAgUlRDX0xBVyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlICsKICAgICAgICAgICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlICsgCiAgICAgICAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nICsgCiAgICAgICAgICAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcsCiAgICAgICAgICAgICAgICAgICAgICBlZmZlY3QgPSAidHdvd2F5cyIsCiAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICAgICAgICAgICAgICAgICAgZGF0YT1kX3BhbmVsX0RPTk9IVUUpCgpzdW1tYXJ5KERPTk9IVUVfT1VUUFVUKQoKRE9OT0hVRV9PVVRQVVRfVElEWSA8LSB0aWR5KERPTk9IVUVfT1VUUFVULCBjb25mLmludCA9IDAuOTUpCgpET05PSFVFX09VVFBVVF9USURZJEFuYWx5c2lzIDwtICJBbmFseXNpcyAxIgpgYGAKCiMjIExvdHQgYW5kIE11c3RhcmQKClNvbWUgY29kZSB0YWtlbiBmcm9tIGh0dHA6Ly9rYXJ0aHVyLm9yZy8yMDE5L2ltcGxlbWVudGluZy1maXhlZC1lZmZlY3RzLXBhbmVsLW1vZGVscy1pbi1yLmh0bWwKCmBgYHtyfQpMT1RUX3ZhcmlhYmxlcyA8LSBMT1RUX0RGICU+JQogIGRwbHlyOjpzZWxlY3QoUlRDX0xBVywKICAgICAgICAgICAgICAgIGNvbnRhaW5zKGMoIldoaXRlIiwiQmxhY2siLCJPdGhlciIpKSwKICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlLAogICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlLAogICAgICAgICAgICAgICAgUG9wdWxhdGlvbl9sb2csCiAgICAgICAgICAgICAgICBwb2xpY2VfcGVyXzEwMGtfbGFnKSAlPiUKICBjb2xuYW1lcygpCgpMT1RUX2ZtbGEgPC0gYXMuZm9ybXVsYShwYXN0ZSgiVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFzdGUoTE9UVF92YXJpYWJsZXMsIGNvbGxhcHNlID0gIiArICIpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICkKICAgICAgICAgICAgICAgICAgICAgICAgKQoKZF9wYW5lbF9MT1RUIDwtIHBkYXRhLmZyYW1lKExPVFRfREYsIGluZGV4PWMoIlNUQVRFIiwgIllFQVIiKSkKCkxPVFRfT1VUUFVUIDwtIHBsbShMT1RUX2ZtbGEsCiAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICAgICAgICAgICAgICAgZWZmZWN0ID0gInR3b3dheXMiLAogICAgICAgICAgICAgICAgICAgICAgZGF0YT1kX3BhbmVsX0xPVFQpCgpzdW1tYXJ5KExPVFRfT1VUUFVUKQoKTE9UVF9PVVRQVVRfVElEWSA8LSB0aWR5KExPVFRfT1VUUFVULCBjb25mLmludCA9IDAuOTUpCgpMT1RUX09VVFBVVF9USURZJEFuYWx5c2lzIDwtICJBbmFseXNpcyAyIgpgYGAKCiMjIENvbXBhcmluZyBhbmFseXNlcwoKYGBge3J9CmNvbXBhcmluZ19hbmFseXNlcyA8LSBET05PSFVFX09VVFBVVF9USURZICU+JQogIGJpbmRfcm93cyhMT1RUX09VVFBVVF9USURZKSAlPiUKICBmaWx0ZXIodGVybSA9PSAiUlRDX0xBV1RSVUUiKQoKbGlicmFyeShncmlkKQoKY29tcGFyaW5nX2FuYWx5c2VzX3Bsb3QgPC0gZ2dwbG90KGNvbXBhcmluZ19hbmFseXNlcykgKyAKICBnZW9tX3BvaW50KGFlcyh4ID0gQW5hbHlzaXMsIHkgPSBlc3RpbWF0ZSkpICsKICBnZW9tX2Vycm9yYmFyKGFlcyh4ID0gQW5hbHlzaXMsIHltaW4gPSBjb25mLmxvdywgeW1heCA9IGNvbmYuaGlnaCksIHdpZHRoID0gMC4yNSkgKyAKICBnZW9tX2hsaW5lKHlpbnRlcmNlcHQgPSAwLCBjb2xvciA9ICJyZWQiKSArCiAgc2NhbGVfeV9jb250aW51b3VzKGJyZWFrcyA9IHNlcSgtMC4yLCAwLjIsIGJ5ID0gMC4wNSksCiAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IHNlcSgtMC4yLCAwLjIsIGJ5ID0gMC4wNSksCiAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoLTAuMiwwLjIpKSArCiAgZ2VvbV9zZWdtZW50KGFlcyh4ID0gMSwgeSA9IDAuMTI1LCB4ZW5kID0gMSwgeWVuZCA9IDAuMTc1KSwKICAgICAgICAgICAgICAgYXJyb3cgPSBhcnJvdyhhbmdsZSA9IDQ1LCBlbmRzID0gImxhc3QiLCB0eXBlID0gIm9wZW4iKSwKICAgICAgICAgICAgICAgc2l6ZSA9IDIsCiAgICAgICAgICAgICAgIGNvbG9yID0gImdyZWVuIiwKICAgICAgICAgICAgICAgbGluZWVuZCA9ICJidXR0IiwKICAgICAgICAgICAgICAgbGluZWpvaW4gPSAibWl0cmUiKSArCiAgZ2VvbV9zZWdtZW50KGFlcyh4ID0gMiwgeSA9IC0wLjEyNSwgeGVuZCA9IDIsIHllbmQgPSAtMC4xNzUpLAogICAgICAgICAgICAgICBhcnJvdyA9IGFycm93KGFuZ2xlID0gNDUsIGVuZHMgPSAibGFzdCIsIHR5cGUgPSAib3BlbiIpLAogICAgICAgICAgICAgICBzaXplID0gMiwKICAgICAgICAgICAgICAgY29sb3IgPSAicmVkIiwKICAgICAgICAgICAgICAgbGluZWVuZCA9ICJidXR0IiwKICAgICAgICAgICAgICAgbGluZWpvaW4gPSAibWl0cmUiKSArCiAgdGhlbWVfbWluaW1hbCgpICsgCiAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpLAogICAgICAgIGF4aXMudGV4dCA9IGVsZW1lbnRfdGV4dChzaXplID0gMTIpKSArCiAgbGFicyh0aXRsZSA9ICJFZmZlY3QgZXN0aW1hdGUgb24gbG4odmlvbGVudCBjcmltZXMgcGVyIDEwMCwwMDAgcGVvcGxlKSIsCiAgICAgICB5ID0gIkVmZmVjdCBlc3RpbWF0ZSAoOTUlIENJKSIpCgpjb21wYXJpbmdfYW5hbHlzZXNfcGxvdApgYGAKCiMgTXVsdGljb2xsaW5lYXJpdHkgYW5hbHlzaXMKCkhvdyBkaWQgdGhlIGFib3ZlIGhhcHBlbj8KClRoZSBhbmFseXNpcyBkYXRhZnJhbWVzIGFyZSB2ZXJ5IHNpbWlsYXIgeWV0IHJlbmRlcmVkIHZlcnkgZGlmZmVyZW50IHJlc3VsdHMuIAoKYGBge3J9CmFsbF9lcXVhbCh0YXJnZXQgPSBET05PSFVFX0RGLAogICAgICAgICAgY3VycmVudCA9IExPVFRfREYsCiAgICAgICAgICBpZ25vcmVfY29sX29yZGVyID0gVFJVRSwKICAgICAgICAgIGlnbm9yZV9yb3dfb3JkZXIgPSBUUlVFKQoKZGltKERPTk9IVUVfREYpWzFdID09IGRpbShMT1RUX0RGKVsxXQpgYGAKClRoZSBvbmx5IGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgdHdvIGRhdGFmcmFtZXMgcmVzdHMgaW4gaG93IHRoZSBkZW1vZ3JhcGhpYyB2YXJpYWJsZXMgd2VyZSBwYXJhbWV0ZXJpemVkLgoKYGBge3J9CkRPTk9IVUVfREYgJT4lCiAgZHBseXI6OnNlbGVjdChjb250YWlucygieWVhcnMiKSkgJT4lCiAgY29sbmFtZXMoKQoKTE9UVF9ERiAlPiUKICBkcGx5cjo6c2VsZWN0KGNvbnRhaW5zKCJ5ZWFycyIpKSAlPiUKICBjb2xuYW1lcygpCmBgYAoKQ2xlYXJseSwgdGhpcyBoYWQgYW4gZWZmZWN0IG9uIHRoZSByZXN1bHRzIG9mIHRoZSBhbmFseXNpcy4gCgpMZXQncyBleHBsb3JlIGhvdyB0aGlzIG9jY3VyZWQuIAoKV2hlbiBzZWVtaW5nbHkgaW5kZXBlbmRlbnQgdmFyaWFibGVzIGFyZSBoaWdobHkgcmVsYXRlZCB0byBvbmUgYW5vdGhlciwgdGhlIHJlbGF0aW9uc2hpcHMgZXN0aW1hdGVkIGluIGFuIGFuYWx5c2lzIG1heSBiZSBkaXN0b3J0ZWQuIAoKSW4gcmVncmVzc2lvbiBhbmFseXNpcywgdGhpcyBkaXN0b3J0aW9uIGlzIG9mdGVuIGEgYnlwcm9kdWN0IG9mIGEgdmlvbGF0aW9uIG9mIHRoZSBpbmRlcGVuZGVuY2UgYXNzdW1wdGlvbi4gVGhpcyBkaXN0b3J0aW9uLCBpZiBsYXJnZSBlbm91Z2gsIGNhbiBpbXBhY3Qgc3RhdGlzdGljYWwgaW5mZXJlbmNlLiAKClRoZXJlIGFyZSBzZXZlcmFsIHdheXMgd2UgY2FuIGRpYWdub3NlIG11bHRpY29sbGluZWFyaXR5LgoKIyMjIENvcnJlbGF0aW9uCgpBZ2FpbiwgbXVsdGljb2xsaW5lYXJpdHkgb2Z0ZW4gb2NjdXJzIHdoZW4gaW5kZXBlbmRlbnQgdmFyaWFibGVzIGFyZSBoaWdobHkgcmVsYXRlZCB0byBvbmUgYW5vdGhlci4gQ29uc2VxdWVudGx5LCB3ZSBjYW4gZXZhbHVhdGUgdGhlc2UgcmVsYXRpb25zaGlwcyBiZSBleGFtaW5pbmcgdGhlIGNvcnJlbGF0aW9uIGJldHdlZW4gdmFyaWFibGUgcGFpcnMuCgo8c3R5bGU+CmRpdi5ibHVlIHsgYmFja2dyb3VuZC1jb2xvcjojZTZmMGZmOyBib3JkZXItcmFkaXVzOiA1cHg7IHBhZGRpbmc6IDIwcHg7fQo8L3N0eWxlPgo8ZGl2IGNsYXNzID0gImJsdWUiPgoKSXQgaXMgaW1wb3J0YW50IHRvIG5vdGUgdGhhdCBtdWx0aWNvbGxpbmVhcml0eSBhbmQgY29ycmVsYXRpb24gYXJlIG5vdCBvbmUgYW5kIHRoZSBzYW1lLiBDb3JyZWxhdGlvbiBjYW4gYmUgdGhvdWdodCBvZiBhcyB0aGUgc3RyZW5ndGggb2YgdGhlIHJlbGF0aW9uc2hpcCBiZXR3ZWVuIHZhcmlhYmxlcy4gT24gdGhlIG90aGVyIGhhbmQsIG11bHRpY29sbGluZWFyaXR5IGNhbiBiZSB0aG91Z2h0IG9mIHRoZSB0aGUgdmlvbGF0aW9uIG9mIHRoZSBpbmRlcGVuZGVuY2UgYXNzdW1wdGlvbiB0aGF0IGlzIGEgY29uc2VxdWVuY2Ugb2YgdGhpcyBjb3JyZWxhdGlvbiBpbiBhIHJlZ3Jlc3Npb24gYW5hbHlzaXMuIAoKPC9kaXY+CgojIyMjIFNjYXR0ZXJwbG90cwoKYGBge3J9CmNvbG5hbWVzKERPTk9IVUVfREYpCgpET05PSFVFX0RGICU+JSAKICBkcGx5cjo6c2VsZWN0KFJUQ19MQVcsCiAgICAgICAgICAgICAgICBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nLAogICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUsCiAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUsCiAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZykgJT4lIAogIGdncGFpcnMoLiwKICAgICAgICAgIGNvbHVtbnMgPSBjKDI6NSksCiAgICAgICAgICBsb3dlciA9IGxpc3QoY29udGludW91cyA9IHdyYXAoInNtb290aF9sb2VzcyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY29sb3IgPSAicmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBhbHBoYSA9IDAuNSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzaXplID0gMC4xKSkpCgpMT1RUX0RGICU+JSAKICBkcGx5cjo6c2VsZWN0KFJUQ19MQVcsCiAgICAgICAgICAgICAgICBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nLAogICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUsCiAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUsCiAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZykgJT4lIAogIGdncGFpcnMoLiwKICAgICAgICAgIGNvbHVtbnMgPSBjKDI6NSksCiAgICAgICAgICBsb3dlciA9IGxpc3QoY29udGludW91cyA9IHdyYXAoInNtb290aF9sb2VzcyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY29sb3IgPSAicmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBhbHBoYSA9IDAuNSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzaXplID0gMC4xKSkpCmBgYAoKIyMjIyBIZWF0bWFwcwoKYGBge3J9CmNvcl9ET05PSFVFX2RlbSA8LSBjb3IoRE9OT0hVRV9ERiAlPiUgZHBseXI6OnNlbGVjdChjb250YWlucygiX3llYXJzIikpKQoKY29ycl9tYXRfRE9OT0hVRSA8LSBnZ2NvcnJwbG90KGNvcl9ET05PSFVFX2RlbSwKICAgICAgICAgICB0bC5jZXggPSA2LAogICAgICAgICAgIGhjLm9yZGVyID0gVFJVRSwKICAgICAgICAgICBjb2xvcnMgPSBjKCJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgIndoaXRlIiwKICAgICAgICAgICAgICAgICAgICAgICJyZWQiKSwKICAgICAgICAgICBvdXRsaW5lLmNvbG9yID0gInRyYW5zcGFyZW50IiwKICAgICAgICAgICB0aXRsZSA9ICJDb3JyZWxhdGlvbiBNYXRyaXgsIEFuYWx5c2lzIDEiLAogICAgICAgICAgIGxlZ2VuZC50aXRsZSA9IFRlWCgiJFxccmhvJCIpKQoKY29ycl9tYXRfRE9OT0hVRQoKY29yX0xPVFRfZGVtIDwtIGNvcihMT1RUX0RGICU+JSBkcGx5cjo6c2VsZWN0KGNvbnRhaW5zKCJfeWVhcnMiKSkpCgpjb3JyX21hdF9MT1RUIDwtIGdnY29ycnBsb3QoY29yX0xPVFRfZGVtLAogICAgICAgICAgIHRsLmNleCA9IDYsCiAgICAgICAgICAgaGMub3JkZXIgPSBUUlVFLAogICAgICAgICAgIGNvbG9ycyA9IGMoInJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAid2hpdGUiLAogICAgICAgICAgICAgICAgICAgICAgInJlZCIpLAogICAgICAgICAgIG91dGxpbmUuY29sb3IgPSAidHJhbnNwYXJlbnQiLAogICAgICAgICAgIHRpdGxlID0gIkNvcnJlbGF0aW9uIE1hdHJpeCwgQW5hbHlzaXMgMiIsCiAgICAgICAgICAgbGVnZW5kLnRpdGxlID0gVGVYKCIkXFxyaG8kIikpCgpjb3JyX21hdF9MT1RUCmBgYAoKIyMjIENvZWZmaWNpZW50IGVzdGltYXRlIGluc3RhYmlsaXR5CgpgYGB7cn0Kc2ltcyA8LSAyNTAKCiMgRE9OT0hVRQoKIyByb3VuZChkaW0oRE9OT0hVRV9ERilbMV0vMikKc2FtcHNfRE9OT0hVRSA8LSBsYXBwbHkocmVwKGRpbShET05PSFVFX0RGKVsxXS0xLCBzaW1zKSwKICAgICAgIGZ1bmN0aW9uKHgpRE9OT0hVRV9ERltzYW1wbGUobnJvdyhET05PSFVFX0RGKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNpemUgPSB4LCByZXBsYWNlID0gRkFMU0UpLF0pCgpmaXRfbmxzX29uX2Jvb3RzdHJhcF9ET05PSFVFIDwtIGZ1bmN0aW9uKHNwbGl0KXsKICBwbG0oVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+CiAgICAgICAgICAgICAgICAgICAgICAgIFJUQ19MQVcgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSArCiAgICAgICAgICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSArIAogICAgICAgICAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZyArIAogICAgICAgICAgICAgICAgICAgICAgICBwb2xpY2VfcGVyXzEwMGtfbGFnLAogICAgICBkYXRhID0gZGF0YS5mcmFtZShzcGxpdCksCiAgICAgIGluZGV4ID0gYygiU1RBVEUiLCJZRUFSIiksCiAgICAgIG1vZGVsID0gIndpdGhpbiIsCiAgICAgIGVmZmVjdCA9ICJ0d293YXlzIikKfQogIApzYW1wc19tb2RlbHNfRE9OT0hVRSA8LSBsYXBwbHkoc2FtcHNfRE9OT0hVRSwgZml0X25sc19vbl9ib290c3RyYXBfRE9OT0hVRSkKCnNhbXBzX21vZGVsc19ET05PSFVFIDwtIHNhbXBzX21vZGVsc19ET05PSFVFICU+JQogIG1hcCh0aWR5KQoKbmFtZXMoc2FtcHNfbW9kZWxzX0RPTk9IVUUpIDwtIHBhc3RlMCgiRE9OT0hVRV8iLDE6bGVuZ3RoKHNhbXBzX21vZGVsc19ET05PSFVFKSkKCnNpbXVsYXRpb25zX0RPTk9IVUUgPC0gc2FtcHNfbW9kZWxzX0RPTk9IVUUgJT4lCiAgYmluZF9yb3dzKC5pZCA9ICJJRCIpICU+JQogIG11dGF0ZShBbmFseXNpcyA9ICJBbmFseXNpcyAxIikKCiMjIExPVFQKCnNhbXBzX0xPVFQgPC0gbGFwcGx5KHJlcChyb3VuZChkaW0oTE9UVF9ERilbMV0vMiksIHNpbXMpLAogICAgICAgZnVuY3Rpb24oeCkgTE9UVF9ERltzYW1wbGUobnJvdyhMT1RUX0RGKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNpemUgPSB4LCByZXBsYWNlID0gRkFMU0UpLF0pCgpmaXRfbmxzX29uX2Jvb3RzdHJhcF9MT1RUIDwtIGZ1bmN0aW9uKHNwbGl0KXsKICBwbG0oTE9UVF9mbWxhLAogICAgICBkYXRhID0gZGF0YS5mcmFtZShzcGxpdCksCiAgICAgIGluZGV4ID0gYygiU1RBVEUiLCJZRUFSIiksCiAgICAgIG1vZGVsID0gIndpdGhpbiIsCiAgICAgIGVmZmVjdCA9ICJ0d293YXlzIikKfQogIApzYW1wc19tb2RlbHNfTE9UVCA8LSBsYXBwbHkoc2FtcHNfTE9UVCwgZml0X25sc19vbl9ib290c3RyYXBfTE9UVCkKCnNhbXBzX21vZGVsc19MT1RUIDwtIHNhbXBzX21vZGVsc19MT1RUICU+JQogIG1hcCh0aWR5KQoKbmFtZXMoc2FtcHNfbW9kZWxzX0xPVFQpIDwtIHBhc3RlMCgiTE9UVF8iLDE6bGVuZ3RoKHNhbXBzX21vZGVsc19MT1RUKSkKCnNpbXVsYXRpb25zX0xPVFQgPC0gc2FtcHNfbW9kZWxzX0xPVFQgJT4lCiAgYmluZF9yb3dzKC5pZCA9ICJBbmFseXNpcyIpICU+JQogIG11dGF0ZShBbmFseXNpcyA9ICJBbmFseXNpcyAyIikKCnNpbXVsYXRpb25zIDwtIGJpbmRfcm93cyhzaW11bGF0aW9uc19ET05PSFVFLAogICAgICAgICAgICAgICAgICAgICAgICAgc2ltdWxhdGlvbnNfTE9UVCkKCnNpbXVsYXRpb25fcGxvdCA8LSBzaW11bGF0aW9ucyAlPiUKICBmaWx0ZXIodGVybT09IlJUQ19MQVdUUlVFIikgJT4lCiAgZ2dwbG90KGFlcyh4ID0gQW5hbHlzaXMsIHkgPSBlc3RpbWF0ZSkpICsgCiAgZ2VvbV9qaXR0ZXIoYWxwaGEgPSAwLjI1LAogICAgICAgICAgICAgIHdpZHRoID0gMC4xKSArIAogIGxhYnModGl0bGUgPSAiQ29lZmZpY2llbnQgaW5zdGFiaWxpdHkiLAogICAgICAgc3VidGl0bGUgPSAiRXN0aW1hdGVzIHNlbnNpdGl2ZSB0byBvYnNlcnZhdGlvbiBkZWxldGlvbnMiLAogICAgICAgeCA9ICJUZXJtIiwKICAgICAgIHkgPSAiQ29lZmZpY2llbnQiLAogICAgICAgY2FwdGlvbiA9ICJSZXN1bHRzIGZyb20gc2ltdWxhdGlvbnMiKSArIAogIHRoZW1lX21pbmltYWwoKSArCiAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKQoKc2ltdWxhdGlvbl9wbG90CmBgYAoKIyMjIFZJRgoKYGBge3J9CmRlc2lnbi5tYXRyaXggPC0gYXMuZGF0YS5mcmFtZShtb2RlbC5tYXRyaXgoRE9OT0hVRV9PVVRQVVQpKQoKZGVzaWduLm1hdHJpeCRWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIDwtIHBsbTo6V2l0aGluKAogIGRfcGFuZWxfRE9OT0hVRSRWaW9sX2NyaW1lX3JhdGVfMWtfbG9nKQoKbG1fRE9OT0hVRSA8LSBsbShWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIH4KICAgICAgICAgICAgICAgICAgICAgICAgUlRDX0xBV1RSVUUgKyAjIGxvZ2ljYWwgY2xhc3MgY2hhbmdlcyB2YXJpYWJsZSBuYW1lIGFmdGVyIGluaXRhbCBtb2RlbAogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSArCiAgICAgICAgICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSArIAogICAgICAgICAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZyArCiAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcsCiAgICAgICAgICAgICBkYXRhID0gZGVzaWduLm1hdHJpeCkKCgp2aWYobG1fRE9OT0hVRSkKCnZpZl9ET05PSFVFIDwtIHZpZihsbV9ET05PSFVFKQoKdmlmX0RPTk9IVUUgPC0gdmlmX0RPTk9IVUUgJT4lCiAgYXNfdGliYmxlKCkgJT4lCiAgY2JpbmQoLiwgbmFtZXModmlmX0RPTk9IVUUpKSAlPiUKICBhc190aWJibGUoKQogIApjb2xuYW1lcyh2aWZfRE9OT0hVRSkgPC0gYygiVklGIiwgIlZhcmlhYmxlIikKCm1heF92aWZfRE9OT0hVRSA8LSBtYXgodmlmKGxtX0RPTk9IVUUpKSAKYGBgCgpgYGB7cn0KZGVzaWduLm1hdHJpeCA8LSBhcy5kYXRhLmZyYW1lKG1vZGVsLm1hdHJpeChMT1RUX09VVFBVVCkpCgpkZXNpZ24ubWF0cml4JFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgPC0gcGxtOjpXaXRoaW4oCiAgZF9wYW5lbF9MT1RUJFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cpCgpMT1RUX3ZhcmlhYmxlc19vbHMgPC0gTE9UVF9ERiAlPiUKICBkcGx5cjo6c2VsZWN0KFJUQ19MQVcsCiAgICAgICAgICAgICAgICBjb250YWlucyhjKCJXaGl0ZSIsIkJsYWNrIiwiT3RoZXIiKSksCiAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSwKICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSwKICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nLAogICAgICAgICAgICAgICAgcG9saWNlX3Blcl8xMDBrX2xhZykgJT4lCiAgY29sbmFtZXMoKSAlPiUKICBzdHJfcmVwbGFjZSgiUlRDX0xBVyIsICJSVENfTEFXVFJVRSIpICMgbG9naWNhbCBjbGFzcyBjaGFuZ2VzIHZhcmlhYmxlIG5hbWUgYWZ0ZXIgaW5pdGFsIG1vZGVsCgpMT1RUX2ZtbGFfb2xzIDwtIGFzLmZvcm11bGEocGFzdGUoIlZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgfiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhc3RlKExPVFRfdmFyaWFibGVzX29scywgY29sbGFwc2UgPSAiICsgIikKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgKQogICAgICAgICAgICAgICAgICAgICAgICApCgpsbV9MT1RUIDwtIGxtKExPVFRfZm1sYV9vbHMsCiAgICAgICAgICAgICBkYXRhID0gZGVzaWduLm1hdHJpeCkKCnZpZihsbV9MT1RUKQoKdmlmX0xPVFQgPC0gdmlmKGxtX0xPVFQpCgp2aWZfTE9UVCA8LSB2aWZfTE9UVCAlPiUKICBhc190aWJibGUoKSAlPiUKICBjYmluZCguLCBuYW1lcyh2aWZfTE9UVCkpICU+JQogIGFzX3RpYmJsZSgpCiAgCmNvbG5hbWVzKHZpZl9MT1RUKSA8LSBjKCJWSUYiLCAiVmFyaWFibGUiKQoKbWF4X3ZpZl9MT1RUIDwtIG1heCh2aWYobG1fTE9UVCkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0V9CiNUaGlzIGNvdWxkIGJlIHVzZWQgdG8gbGFiZWwgdGhlIG1heCBWSUYgb2YgZWFjaCBhbmFseXNpcwoKbWF4X3ZpZl9ET05PSFVFCm1heF92aWZfTE9UVApgYGAKCiQkXGZyYWN7MX17MS1SX3tpfV57Mn19JCQKCmBgYHtyfQp2aWZfRE9OT0hVRSRBbmFseXNpcyA8LSAiQW5hbHlzaXMgMSIKdmlmX0xPVFQkQW5hbHlzaXMgPC0gIkFuYWx5c2lzIDIiCgp2aWZfZGYgPC0gcmJpbmQodmlmX0RPTk9IVUUsCiAgICAgICAgICAgICAgICB2aWZfTE9UVCkKCnZpZl9wbG90IDwtIHZpZl9kZiAlPiUKICBnZ3Bsb3QoYWVzKHggPSBBbmFseXNpcywgeSA9IFZJRikpICsKICBnZW9tX2ppdHRlcih3aWR0aCA9IDAuMSwgYWxwaGEgPSAwLjUsIHNpemUgPSAyKSArCiAgZ2VvbV9obGluZSh5aW50ZXJjZXB0ID0gMTAsIGNvbG9yID0gInJlZCIpICsKICBzY2FsZV95X2NvbnRpbnVvdXModHJhbnMgPSAnbG9nMTAnLAogICAgICAgICAgICAgICAgICAgICBsaW1pdHMgPSBjKDEsMTAwMCkpICsKICBsYWJzKHRpdGxlID0gIlZhcmlhbmNlIGluZmxhdGlvbiBmYWN0b3JzIikgKyAKICB0aGVtZV9taW5pbWFsKCkgKwogIHRoZW1lKGF4aXMudGl0bGUueCA9IGVsZW1lbnRfYmxhbmsoKSkKCnZpZl9wbG90CmBgYAoKIyBTeW50aGVzaXMKCmBgYHtyLCBmaWcuaGVpZ2h0PTEwLCBlY2hvPUZBTFNFLCBtZXNzYWdlPUZBTFNFLCB3YXJuaW5nPUZBTFNFfQp0aXRsZV9wbG90cyA8LSBnZ2RyYXcoKSArIAogIGRyYXdfbGFiZWwoCiAgICAiTXVsdGljb2xsaW5lYXJpdHkgYW5kIGl0cyBlZmZlY3RzIiwKICAgIGZvbnRmYWNlID0gJ2JvbGQnLAogICAgc2l6ZT0xOCwKICAgIHggPSAwLAogICAgaGp1c3QgPSAwCiAgKSArCiAgdGhlbWUoCiAgICBwbG90Lm1hcmdpbiA9IG1hcmdpbigwLCAwLCAwLCAwKQogICkKCmZvcndhcmQgPC0gZ2dkcmF3KCkgKyAKICBkcmF3X2xhYmVsKAogICAgIkFuYWx5c2lzIDE6IDYgZGVtb2dyYXBoaWMgdmFyaWFibGVzXG5BbmFseXNpcyAyOiAzNiBkZW1vZ3JhcGhpYyB2YXJpYWJsZXMiLAogICAgZm9udGZhY2UgPSAnYm9sZCcsCiAgICBzaXplPTEwLAogICAgeCA9IDAsCiAgICBoanVzdCA9IDAKICApICsKICB0aGVtZSgKICAgIHBsb3QubWFyZ2luID0gbWFyZ2luKDAsIDAsIDAsIDApCiAgKQoKY29ycl9tYXRfRE9OT0hVRSA8LSBnZ2NvcnJwbG90KGNvcl9ET05PSFVFX2RlbSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRsLmNleCA9IDYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBoYy5vcmRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBvdXRsaW5lLmNvbG9yID0gInRyYW5zcGFyZW50IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbG9ycyA9IGMoInJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJ3aGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJyZWQiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxlZ2VuZC50aXRsZSA9IFRlWCgiJFxccmhvJCIpKSArCiAgdGhlbWVfdm9pZCgpICsgCiAgdGhlbWUocGxvdC50aXRsZT0gZWxlbWVudF90ZXh0KHNpemU9OCkpICsKICBsYWJzKHRpdGxlID0gIkFuYWx5c2lzIDEiKSAKCmNvcnJfbWF0X0xPVFQgPC0gZ2djb3JycGxvdChjb3JfTE9UVF9kZW0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICB0bC5jZXggPSA2LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgaGMub3JkZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgb3V0bGluZS5jb2xvciA9ICJ0cmFuc3BhcmVudCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb2xvcnMgPSBjKCJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAid2hpdGUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAicmVkIiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZWdlbmQudGl0bGUgPSBUZVgoIiRcXHJobyQiKSkgKwogIHRoZW1lX3ZvaWQoKSArIAogIHRoZW1lKHBsb3QudGl0bGUgPSBlbGVtZW50X3RleHQoc2l6ZT04KSkgKwogIGxhYnModGl0bGUgPSAiQW5hbHlzaXMgMiIpIAoKcGxvdF9BMSA8LSBjb3JyX21hdF9ET05PSFVFCgpwbG90X0EyIDwtIGNvcnJfbWF0X0xPVFQKCnJvd19BIDwtIHBsb3RfZ3JpZChwbG90X0ExLAogICAgICAgICAgICAgICAgICAgcGxvdF9BMiwKICAgICAgICAgICAgICAgICAgIG5yb3cgPSAxKQoKdGl0bGVfQSA8LSBnZ2RyYXcoKSArIAogIGRyYXdfbGFiZWwoCiAgICAiQ29ycmVsYXRpb24gYmV0d2VlbiB2YXJpYWJsZXMgY2FuIGluZHVjZSBtdWx0aWNvbGxpbmVhcml0eSIsCiAgICBmb250ZmFjZSA9ICdib2xkJywKICAgIHNpemU9MTQsCiAgICB4ID0gMCwKICAgIGhqdXN0ID0gMAogICkgKwogIHRoZW1lKAogICAgcGxvdC5tYXJnaW4gPSBtYXJnaW4oMCwgMCwgMCwgMCkKICApCgpsZWdlbmRfQSA8LSBnZXRfbGVnZW5kKGNvcnJfbWF0X0xPVFQpCgpwbG90X0EgPC0gcGxvdF9ncmlkKHRpdGxlX0EsCiAgICAgICAgICAgICAgICAgICAgcm93X0EsCiAgICAgICAgICAgICAgICAgICAgbmNvbCA9IDEsCiAgICAgICAgICAgICAgICAgICAgcmVsX2hlaWdodHMgPSBjKDAuMSwxKSkKCmVtcHR5X2RmIDwtIGNiaW5kKGMoMToxMCksYygxOjEwKSkgJT4lCiAgYXMuZGF0YS5mcmFtZSgpCgpjb2xuYW1lcyhlbXB0eV9kZikgPC0gYygiWCIsICJZIikKCnBsb3RfQjEgPC0gZ2dwbG90KGVtcHR5X2RmLCBhZXMoeCA9IFgsIHkgPSBZKSkgKwogIGFubm90YXRlKCJ0ZXh0IiwKICAgICAgICAgICB4PTUsCiAgICAgICAgICAgeT01LAogICAgICAgICAgIGxhYmVsID0gVGVYKCIkVklGX3tpfSA9IFxcZnJhY3sxfXsxLVJfe2l9XnsyfX0kIiksCiAgICAgICAgICAgc2l6ZSA9IDgpICsKICB0aGVtZV92b2lkKCkKCnBsb3RfQjIgPC0gdmlmX3Bsb3QgKwogIHRoZW1lKGF4aXMudGl0bGUueCA9IGVsZW1lbnRfdGV4dChzaXplPTgpKQoKcm93X0IgPC0gcGxvdF9ncmlkKHBsb3RfQjEsCiAgICAgICAgICAgICAgICAgICAgICAgcGxvdF9CMiwKICAgICAgICAgICAgICAgICAgICAgICBucm93ID0gMSkKCnRpdGxlX0IgPC0gZ2dkcmF3KCkgKyAKICBkcmF3X2xhYmVsKAogICAgIlZhcmlhbmNlIGluZmxhdGlvbiBmYWN0b3JzIGNhbiBiZSB1c2VkIHRvIGlkZW50aWZ5IG11bHRpY29sbGluZWFyaXR5IHdoZW4gcHJlc2VudCIsCiAgICBmb250ZmFjZSA9ICdib2xkJywKICAgIHNpemU9MTQsCiAgICB4ID0gMCwKICAgIGhqdXN0ID0gMAogICkgKwogIHRoZW1lKAogICAgcGxvdC5tYXJnaW4gPSBtYXJnaW4oMCwgMCwgMCwgMCkKICApCgpwbG90X0IgPC0gcGxvdF9ncmlkKHRpdGxlX0IsCiAgICAgICAgICAgICAgICAgICAgcm93X0IsCiAgICAgICAgICAgICAgICAgICAgbmNvbCA9IDEsCiAgICAgICAgICAgICAgICAgICAgcmVsX2hlaWdodHMgPSBjKDAuMSwxKSkKCnBsb3RfQzEgPC0gY29tcGFyaW5nX2FuYWx5c2VzX3Bsb3QgKyAKICB0aGVtZShheGlzLnRleHQueCA9IGVsZW1lbnRfdGV4dChzaXplID0gOCksCiAgICAgICAgYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKSArCiAgbGFicyh0aXRsZSA9ICJJbnRyb2R1Y2VzIGJpYXMgdG8gZXN0aW1hdGVzIiwKICAgICAgIHN1YnRpdGxlID0gIkJpYXMgaW50cm9kdWNlZCBjYW4gY2hhbmdlIGRpcmVjdGlvbiBvZiBlc3RpbWF0ZSIpCgpwbG90X0MyIDwtIHNpbXVsYXRpb25fcGxvdCArCiAgbGFicyh0aXRsZSA9ICJSZWR1Y2VzIHByZWNpc2lvbiBpbiBlc3RpbWF0ZXMiKQoKcm93X0MgPC0gcGxvdF9ncmlkKHBsb3RfQzEsCiAgICAgICAgICAgICAgICAgICAgICAgcGxvdF9DMiwKICAgICAgICAgICAgICAgICAgICAgICBucm93ID0gMSkKCnRpdGxlX0MgPC0gZ2dkcmF3KCkgKyAKICBkcmF3X2xhYmVsKAogICAgIk11bHRpY29sbGluZWFyaXR5IGNhbiBoYXZlIGEgbmVnYXRpdmUgZWZmZWN0IG9uIHN0YXRpc3RpY2FsIGluZmVyZW5jZSIsCiAgICBmb250ZmFjZSA9ICdib2xkJywKICAgIHNpemU9MTQsCiAgICB4ID0gMCwKICAgIGhqdXN0ID0gMAogICkgKwogIHRoZW1lKAogICAgcGxvdC5tYXJnaW4gPSBtYXJnaW4oMCwgMCwgMCwgMCkKICApCgpwbG90X0MgPC0gcGxvdF9ncmlkKHRpdGxlX0MsCiAgICAgICAgICAgICAgICAgICAgcm93X0MsCiAgICAgICAgICAgICAgICAgICAgbmNvbCA9IDEsCiAgICAgICAgICAgICAgICAgICAgcmVsX2hlaWdodHMgPSBjKDAuMSwxKSkKCnBsb3RzIDwtIHBsb3RfZ3JpZChwbG90X0EsCiAgICAgICAgICAgICAgICAgICBwbG90X0IsCiAgICAgICAgICAgICAgICAgICBwbG90X0MsCiAgICAgICAgICBuY29sID0gMSwKICAgICAgICAgIHJlbF9oZWlnaHRzID0gYygxLDEsMSkpCgptYWlucGxvdCA8LSBwbG90X2dyaWQodGl0bGVfcGxvdHMsCiAgICAgICAgICAgICAgICAgICAgICAgZm9yd2FyZCwKICAgICAgICAgICAgICAgICAgICAgICBwbG90cywKICAgICAgICAgICAgICAgICAgICAgICAjbGVnZW5kX3V3LAogICAgICAgICAgICAgICAgICAgICAgIG5jb2wgPSAxLAogICAgICAgICAgICAgICAgICAgICAgIHJlbF9oZWlnaHRzID0gYygwLjA1LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjA1LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxKSkKCm1haW5wbG90CmBgYAoKCgpgYGB7ciwgZWNobz1GQUxTRSwgaW5jbHVkZT1GQUxTRX0KZ2dzYXZlKGhlcmU6OmhlcmUoImltZyIsICJtYWlucGxvdC5wbmciKSkKYGBgCgoKCgojICoqRGF0YSBWaXN1YWxpemF0aW9uKioKKioqIAoKIyAqKlN1bW1hcnkqKgoqKiogCgojICoqU3VnZ2VzdGVkIEhvbWV3b3JrKioKKioqIAoKIyAqKkhlbHBmdWwgTGlua3MqKgoqKiogCgpodHRwczovL3JwdWJzLmNvbS9yc2xibGlzcy9maXhlZF9lZmZlY3RzCgpodHRwOi8va2FydGh1ci5vcmcvMjAxOS9pbXBsZW1lbnRpbmctZml4ZWQtZWZmZWN0cy1wYW5lbC1tb2RlbHMtaW4tci5odG1sCgpodHRwczovL3N0YXRzLnN0YWNrZXhjaGFuZ2UuY29tL3F1ZXN0aW9ucy85OTIzNi9lZmZlY3RzLWluLXBhbmVsLW1vZGVscy1pbmRpdmlkdWFsLXRpbWUtb3ItdHdvd2F5cwoK